-- Logs begin at Tue 2022-07-19 15:02:25 UTC, end at Tue 2022-07-19 16:03:12 UTC. -- Jul 19 15:36:21.808679 dv-cinder-849022-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 19 15:36:21.818200 dv-cinder-849022-3-iscsi devstack@n-api.service[115001]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 19 15:36:21.820273 dv-cinder-849022-3-iscsi devstack@n-api.service[115001]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 19 15:36:21 2022] *** Jul 19 15:36:21.820273 dv-cinder-849022-3-iscsi devstack@n-api.service[115001]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 19 15:36:21.820273 dv-cinder-849022-3-iscsi devstack@n-api.service[115001]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 19 15:36:21.820273 dv-cinder-849022-3-iscsi devstack@n-api.service[115001]: nodename: dv-cinder-849022-3-iscsi Jul 19 15:36:21.820273 dv-cinder-849022-3-iscsi devstack@n-api.service[115001]: machine: x86_64 Jul 19 15:36:21.820273 dv-cinder-849022-3-iscsi devstack@n-api.service[115001]: clock source: unix Jul 19 15:36:21.820273 dv-cinder-849022-3-iscsi devstack@n-api.service[115001]: pcre jit disabled Jul 19 15:36:21.820273 dv-cinder-849022-3-iscsi devstack@n-api.service[115001]: detected number of CPU cores: 4 Jul 19 15:36:21.820273 dv-cinder-849022-3-iscsi devstack@n-api.service[115001]: current working directory: / Jul 19 15:36:21.820273 dv-cinder-849022-3-iscsi devstack@n-api.service[115001]: detected binary path: /usr/bin/uwsgi-core Jul 19 15:36:21.820963 dv-cinder-849022-3-iscsi devstack@n-api.service[115001]: your processes number limit is 47680 Jul 19 15:36:21.820963 dv-cinder-849022-3-iscsi devstack@n-api.service[115001]: your memory page size is 4096 bytes Jul 19 15:36:21.820963 dv-cinder-849022-3-iscsi devstack@n-api.service[115001]: detected max file descriptor number: 2048 Jul 19 15:36:21.820963 dv-cinder-849022-3-iscsi devstack@n-api.service[115001]: lock engine: pthread robust mutexes Jul 19 15:36:21.820963 dv-cinder-849022-3-iscsi devstack@n-api.service[115001]: thunder lock: enabled Jul 19 15:36:21.820963 dv-cinder-849022-3-iscsi devstack@n-api.service[115001]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 19 15:36:21.820963 dv-cinder-849022-3-iscsi devstack@n-api.service[115001]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 19 15:36:21.866316 dv-cinder-849022-3-iscsi devstack@n-api.service[115001]: Python main interpreter initialized at 0x55cfdf60e9c0 Jul 19 15:36:21.866316 dv-cinder-849022-3-iscsi devstack@n-api.service[115001]: python threads support enabled Jul 19 15:36:21.866316 dv-cinder-849022-3-iscsi devstack@n-api.service[115001]: your server socket listen backlog is limited to 100 connections Jul 19 15:36:21.866316 dv-cinder-849022-3-iscsi devstack@n-api.service[115001]: your mercy for graceful operations on workers is 90 seconds Jul 19 15:36:21.866699 dv-cinder-849022-3-iscsi devstack@n-api.service[115001]: mapped 403077 bytes (393 KB) for 2 cores Jul 19 15:36:21.866777 dv-cinder-849022-3-iscsi devstack@n-api.service[115001]: *** Operational MODE: preforking *** Jul 19 15:36:21.866998 dv-cinder-849022-3-iscsi devstack@n-api.service[115001]: *** uWSGI is running in multiple interpreter mode *** Jul 19 15:36:21.866998 dv-cinder-849022-3-iscsi devstack@n-api.service[115001]: spawned uWSGI master process (pid: 115001) Jul 19 15:36:21.867191 dv-cinder-849022-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 19 15:36:21.870387 dv-cinder-849022-3-iscsi devstack@n-api.service[115001]: spawned uWSGI worker 1 (pid: 115002, cores: 1) Jul 19 15:36:21.870387 dv-cinder-849022-3-iscsi devstack@n-api.service[115001]: spawned uWSGI worker 2 (pid: 115003, cores: 1) Jul 19 15:36:21.870387 dv-cinder-849022-3-iscsi devstack@n-api.service[115001]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 19 15:36:22.542884 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 19 15:36:22.547494 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 19 15:36:23.684754 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 19 15:36:23.684754 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: from cryptography.utils import int_from_bytes Jul 19 15:36:23.685222 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 19 15:36:23.685222 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: from cryptography.utils import int_from_bytes Jul 19 15:36:23.690189 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 19 15:36:23.690189 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: from cryptography.utils import int_from_bytes Jul 19 15:36:23.690734 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 19 15:36:23.690734 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: from cryptography.utils import int_from_bytes Jul 19 15:36:26.218940 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 19 15:36:26.219512 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 19 15:36:26.219725 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 19 15:36:26.220088 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 19 15:36:26.220349 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 19 15:36:26.220738 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.221063 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.221384 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.221702 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.222034 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.222340 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.222684 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.223005 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.223330 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.223590 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.223904 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.224228 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849022-3-iscsi {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.224547 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.224851 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.225159 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.225270 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 19 15:36:26.225620 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.225713 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 19 15:36:26.225804 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.226006 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 19 15:36:26.226110 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.226438 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.226539 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 19 15:36:26.226628 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 19 15:36:26.226867 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.228051 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.228194 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.228323 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.228453 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.228595 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.228720 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.228842 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.228954 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.229075 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.229284 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.229405 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.229528 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.229662 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.229792 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.229904 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.230035 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.230160 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.230160 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.230412 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.230540 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.230664 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.230800 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849022-3-iscsi {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.230931 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849022-3-iscsi {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.231066 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.231198 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.231336 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.231467 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.231581 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.231702 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.231824 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.231969 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.232096 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.232215 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.232348 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.232471 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.232594 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.232729 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.232853 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.233018 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.233145 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.233274 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.233407 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.233538 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.233694 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.233829 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.234632 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.234735 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.235012 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.235215 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.235503 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.235600 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.235817 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.235908 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.236128 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.236223 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.236450 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.236539 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.236756 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.236845 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.237061 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.237148 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849022-3-iscsi {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.237313 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.237451 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.237622 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.237760 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.237942 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.238089 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.238263 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.238504 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.238597 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.238848 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.238948 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.239098 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.239200 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.239417 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.239524 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.239737 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.239843 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.240043 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.240131 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.240348 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.240446 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.240656 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.240753 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.240963 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.241058 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.241265 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.241361 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.241569 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.241666 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.241873 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.241959 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.242175 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.242261 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.242508 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.242611 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.242811 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.242905 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.243111 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.243200 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.243364 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.243450 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.243646 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.243733 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.243961 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.244104 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.64 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.244275 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.244364 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.64 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.244590 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.244678 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.244837 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.244967 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.245081 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.245285 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.245378 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.245594 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.245689 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.245913 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.246002 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.246233 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.246331 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.246564 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.246654 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.246867 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.246963 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.247168 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.247307 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.247474 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.247575 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.247772 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.247859 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.248072 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.248160 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.248332 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.248427 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.248633 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.248720 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.248937 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.249025 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.249253 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.249354 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.249556 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.249671 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.250066 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.250270 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.64 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.250387 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.250671 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.64 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.250769 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.250981 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.251070 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.251285 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.251371 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.251590 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.251682 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.251896 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.251995 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.252202 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.252311 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.252506 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.252594 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.252808 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.252901 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.253108 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.253258 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.253408 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.253494 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.253722 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.253809 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.254039 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.254144 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.254345 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.254462 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.254670 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.254760 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.254967 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.255062 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.255269 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.255366 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.255582 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.255668 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.255883 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.255978 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.256184 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.256284 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.256485 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.256583 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.256779 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.256877 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.257079 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.257173 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.257380 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.257457 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.257681 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.257758 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.257978 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.258114 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.258280 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.258396 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.258602 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.258698 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.258900 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.258987 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.259200 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.259293 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.259500 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.259588 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.259798 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.259884 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.260097 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.260192 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.260398 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.260487 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.260694 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.260780 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.260993 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.261160 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.261290 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.261385 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.261593 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.261687 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.261888 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.261973 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.262187 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.262274 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.262523 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.262612 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.262824 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.262931 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.263123 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.263210 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.263423 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.263518 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.263722 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.263827 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.264022 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.264147 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.264334 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.264421 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.264631 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.264727 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.264930 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.265017 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.265283 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.265371 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.265647 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.265790 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.265963 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.266210 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.266297 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.266548 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.266675 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.266854 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.266949 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.267155 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.267248 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.267462 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.267575 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.267763 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.267855 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.268063 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.268154 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.268359 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.268460 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.268673 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.268764 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.268989 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.269080 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.269296 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.269396 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.269598 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.269688 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.269905 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.269996 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.270221 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.270313 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:36:26.270578 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.270669 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.270896 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.270997 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.271205 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.271296 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.271541 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.271631 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.271869 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.271969 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.272180 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.272270 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.272497 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.272587 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.272803 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.272893 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.273109 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.273199 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.273418 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.273509 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.273723 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.273813 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.274030 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.274141 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.274337 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.274462 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.274670 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.274767 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.274982 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.275073 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.275294 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.275396 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.275604 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.275708 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.275912 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.276001 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.276220 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.276311 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.276525 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.276658 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.276838 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.276938 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.277156 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.277243 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.277472 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.277571 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.277776 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.277872 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.278089 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.278177 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.278419 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.278526 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.278982 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.279094 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.279290 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.279379 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.279593 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.279682 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.279894 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.279982 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.280194 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.280282 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.280499 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.280588 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.280801 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.281382 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.281694 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.281885 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.282027 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.282338 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.282477 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.282687 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.282776 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.282994 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.283097 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.283304 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.283391 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.283611 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.283709 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.283920 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.284010 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.284220 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.284365 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.284533 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.284628 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.284842 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.284930 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.285145 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.285232 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.285469 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.285556 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.285780 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.285869 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.286084 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.286170 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.286430 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.286534 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.286739 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.286828 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.287040 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.287130 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.287346 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.287432 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.287648 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.287736 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.287953 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.288039 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.288259 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.288355 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.288568 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.288654 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.288892 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.288987 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.289195 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.289292 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.289504 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.289591 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.289814 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.289899 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.290120 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.290220 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.290448 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.290538 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.290760 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.290849 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.291062 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.291150 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.291372 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.291460 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.291678 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.291765 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.291982 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.292080 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.292282 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.292369 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.292586 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.292677 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.292887 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.292985 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.293192 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.293278 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.293489 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.293575 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.293791 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.293879 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.294097 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.294184 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.294422 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.294514 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.294728 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.294825 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.295036 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.295122 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.295346 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.295446 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.295645 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.295740 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.295947 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.296035 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.296251 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.296348 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.297131 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.297279 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.297596 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.297804 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.298016 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.298146 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.298381 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.298499 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.298708 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.298825 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.299037 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.299137 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.299353 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.299449 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.299671 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.299759 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.299986 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.300082 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.300300 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.300387 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.300601 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.300688 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.300906 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.300995 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.301206 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.301304 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.301508 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.301597 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.301808 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.301897 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.302109 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.302196 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.302439 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.302531 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.302763 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.302853 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.303070 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.303157 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.303371 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.303468 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.303669 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.303804 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.303968 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.304063 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.304306 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.304401 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.304609 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.304697 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.304937 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.305023 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.305250 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.305346 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.305567 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.305655 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.305877 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.305964 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.306182 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.306278 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.306514 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.306603 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.306820 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.306906 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.307131 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.307220 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.307438 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.307530 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.307744 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.307830 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.308054 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.308141 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.308359 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.308445 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.308672 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.308758 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.308976 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.309076 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.309278 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.309364 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.309588 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.309675 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.309904 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.309999 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.310206 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.310293 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.310542 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.310632 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.310873 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.310961 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.311198 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.311286 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.311507 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.311603 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.311818 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.311906 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.312154 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.312277 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.312474 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.312691 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.312780 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.313062 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.313151 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.313375 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.313462 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.313683 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.313771 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.313990 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.314075 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.314293 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.314428 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.314629 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.314717 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.314934 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.315028 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.315239 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.315344 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.315544 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.315631 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.315848 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.315933 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.316164 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.316261 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.316464 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.316550 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.316774 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.316867 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.317096 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.317192 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.317423 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.317508 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.317729 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.317817 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.318035 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.318136 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.318373 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.318462 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.318681 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.318768 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.318984 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.319071 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.319289 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.319384 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.319587 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.319679 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.319888 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.319990 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.320193 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.320280 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.320504 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.320591 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.320809 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.320898 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.321115 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.321209 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.321417 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.321506 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.321724 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.321812 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.322025 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.322117 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.322327 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.322448 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.322652 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.322785 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.322959 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.323045 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.323269 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.323411 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.323574 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.323661 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.323878 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.323960 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.324185 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.324286 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.324486 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.324572 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.324789 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.324874 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.325094 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.325189 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.325401 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.325494 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.325701 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.325787 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.325998 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.326084 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.326297 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.326401 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.326664 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.326889 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.326990 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.327222 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.327310 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.327538 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.327674 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.327883 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.327988 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.328201 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.328467 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.328554 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.328785 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.328872 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.329097 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.329184 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.329405 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.329493 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.329725 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.329823 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.330038 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.330138 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.330347 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.330466 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.330675 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.330770 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.330979 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.331078 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.331280 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.331369 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.331584 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.331668 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.331884 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.331980 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.332193 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.332280 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.332497 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.332583 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.332803 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.332891 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.333103 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.333197 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.333410 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.333497 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.333723 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.333811 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.334032 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.334282 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.334388 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.334650 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.334751 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.334962 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.335051 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.335268 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.335354 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.335572 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.335660 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.335873 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.335960 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.336177 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.336273 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.336508 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.336595 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.336810 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.336900 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.337126 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.337223 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.337433 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.337596 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.337730 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.337819 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.338023 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.338111 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.338334 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.338478 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.338658 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.338756 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.338961 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.339049 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.339262 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.339359 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.339562 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.339649 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.339860 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.339952 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.340161 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.340257 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.340459 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.340546 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.340757 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.340844 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.341065 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.341153 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.341360 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.341495 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.341665 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.341753 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.341962 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.342050 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.342268 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.342380 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.342595 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.342683 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.342894 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.342983 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.343194 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.343288 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.344007 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.344109 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.344309 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.344616 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.344710 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.344923 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.345061 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.345225 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.345315 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.345533 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.345622 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.345833 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.345920 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.346146 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.346243 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.346477 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.346572 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.346779 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.346867 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.347081 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.347171 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.347392 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.347479 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.347690 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.347825 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.347999 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.348087 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.348305 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.348393 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.348604 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.348706 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.348917 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.349004 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.349225 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.349320 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.349532 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.349629 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.349839 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.349927 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.350140 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.350227 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.350469 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.350571 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.350771 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.350859 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.351080 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.351175 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.351384 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.351472 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.351680 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.351766 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.351976 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.352063 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.352275 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.352363 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.352575 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.352661 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.352875 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.352963 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.353172 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.353260 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.353468 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.353555 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.353766 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.353861 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.354067 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.354155 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.354462 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.354556 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.354684 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.354781 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.354988 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.355076 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.355285 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.355371 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.355581 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.355677 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.355878 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.355971 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.356190 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.356277 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.356491 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.356591 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.356789 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.356875 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.357093 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.357182 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.357390 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.357485 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.357690 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.357777 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.357996 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.358082 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.358313 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.358420 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.358651 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.358740 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.358949 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.359623 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.359838 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.360012 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.360101 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.360476 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.360563 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.360789 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.360886 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.361099 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.361186 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.361410 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.361497 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.361713 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.361814 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.362016 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.362111 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.362319 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.362446 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.362647 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.362736 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.362948 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.363035 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.363268 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.363362 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.363574 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.363661 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.363876 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.363962 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.364177 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.364271 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.364476 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.364563 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.364817 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.364905 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.365121 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.365250 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.365431 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.365526 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.365741 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.365836 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.366053 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.366141 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.366380 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.366473 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.366690 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.366778 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.366996 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.367160 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.367303 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.367389 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.367601 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.367687 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.367913 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.368053 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.368221 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.368309 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.368524 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.368612 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.368827 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.368922 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.369127 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.369214 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.369436 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.369524 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.369739 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.369840 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.370042 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.370163 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.370376 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.370500 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.370703 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.370816 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.371023 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.371111 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.371323 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.371417 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.371629 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.371724 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.371937 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.372025 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.372243 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.372336 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.372550 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.372638 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.372854 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.372988 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.373158 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.373296 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.373465 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.373604 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.373773 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.373914 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.374083 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.374215 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.374415 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.374543 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.374782 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.374927 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.375279 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.375381 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.375679 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.375769 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.375984 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.376072 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.376288 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.376386 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.376607 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.376702 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.376909 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.376997 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.377215 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.377312 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.377520 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.377628 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.377829 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.377939 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.378134 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.378246 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.378583 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.378676 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.378899 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.378986 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.379208 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.379298 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.379511 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.379600 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.379817 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.379904 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.380123 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.380213 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.380435 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.380524 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.380745 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.380832 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.381046 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.381135 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.381390 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.381477 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.381712 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.381809 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.382021 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.382117 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.382333 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.382454 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.382659 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.382765 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.382960 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.383048 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.383270 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.383358 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.383585 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.383680 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.383885 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.383971 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.384184 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.384304 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.384484 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.384646 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.384804 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.384902 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.385106 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.385223 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.385423 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.385549 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.385836 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.385933 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.386141 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.386228 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.386466 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.386559 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.386832 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.386922 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.387137 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.387225 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.387462 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.387552 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.387768 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.387858 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.388080 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.388168 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.388392 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.388526 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.388692 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.388780 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.388992 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.389078 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.389296 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.389383 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.389614 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.389710 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.389915 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.390003 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.390256 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.390428 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.390610 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.390795 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.390936 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.391169 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.391257 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.391497 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.391587 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.391819 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.391907 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.392131 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.392226 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.392437 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.392525 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.392741 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.392837 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.393043 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.393156 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.393382 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.393479 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.393689 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.393785 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.394009 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.394106 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.394337 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.394457 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.394679 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.394766 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.394986 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.395084 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.395288 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.395376 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.395590 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.395678 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.395910 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.396008 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.396213 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.396308 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.396520 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.396614 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.396824 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.396925 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.397126 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.397214 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.397425 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.397512 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.397725 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.397821 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.398029 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.398127 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.398330 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.398438 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.398660 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.398750 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.398963 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.399053 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.399265 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.399352 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.399566 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.399655 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.399870 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.399957 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.400173 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.400260 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.400482 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.400569 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.400782 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.400882 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.401081 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.401181 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.401378 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.401464 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.401675 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.401811 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.402003 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.402103 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.402304 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.402420 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.402658 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.402744 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.402972 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.403071 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.403277 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.403364 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.403603 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.403689 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.404165 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.404262 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.404475 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.404562 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.404789 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.404875 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.405103 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.405230 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.405401 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.405490 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.405701 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.405788 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.406645 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.406762 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.406960 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.407219 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.407384 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.407540 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.407700 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.407849 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.408016 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.408161 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.408332 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.408465 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.408650 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.408768 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.409072 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.409159 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.409400 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.409501 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.409704 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.409799 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.410026 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.410163 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.410334 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.410458 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.410659 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.410748 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.410963 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.411051 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.411264 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.411365 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.411587 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.411676 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.411897 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.411993 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.412207 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.412296 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.412528 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.412616 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.412845 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.412971 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.413167 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.413257 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.413473 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.413559 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.413795 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.413884 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.414104 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.414200 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.414442 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.414551 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.414754 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.414879 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.415065 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.415154 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.415377 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.415466 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.415687 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.415831 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.415995 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.416084 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.416299 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.416385 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.416609 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.416708 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.416918 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.417006 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.417224 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.417311 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.417535 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.417737 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.417847 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.418061 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.418150 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.418392 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.418542 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.418706 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.418836 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.419014 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.419149 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.419328 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.419473 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.419637 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.419806 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.419957 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.420125 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.420237 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.420440 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.420529 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.420754 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.420841 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.421075 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.421172 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.421445 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.422215 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.422528 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.422653 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.422999 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.423176 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.423323 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.423455 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.423650 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.423739 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.423969 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.424067 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.424282 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.424369 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.424608 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.424706 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.424916 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.425009 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.425224 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.425320 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.425533 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.425620 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.425839 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.425927 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.426144 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.426232 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.426479 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.426585 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.426788 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.426876 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.427090 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.427176 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.427399 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.427498 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.427708 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.427794 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.428012 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.428246 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.428336 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.428590 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.428687 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.428906 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.429006 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.429230 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.429326 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.429552 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.429648 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.429864 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.429953 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.430168 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.430267 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.430512 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.430602 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.430818 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.431030 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.431119 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.431342 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.431431 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.431671 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.431758 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.431991 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.432079 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.432300 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.432388 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.432609 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.432697 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.432918 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.433012 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.433221 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.433310 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.433526 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.433619 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.433825 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.433920 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.434129 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.434223 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.434460 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.434553 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.434761 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.434861 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.435059 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.435193 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.435364 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.435479 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.435659 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.435759 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.435957 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.436044 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.436261 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.436350 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.436563 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.436789 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.436878 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.437183 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.437299 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.437487 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.437712 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.437803 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.438083 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.438170 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.438405 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.438496 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.438717 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.438807 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.439066 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.439154 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.439388 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.439474 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.439689 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.439790 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.439987 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.440074 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.440297 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.440385 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.440601 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.440697 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.440904 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.440993 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.441202 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.441302 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.441507 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.441595 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.441812 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.441900 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.442112 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.442208 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.442438 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.442710 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.442799 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.443050 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.443149 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.443350 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.443439 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.443650 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.443744 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.443950 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.444038 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.444257 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.444346 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.444557 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.444644 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.444856 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.444952 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.445161 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.445277 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.445462 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.445570 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.445768 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.445866 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.446065 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.446155 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.446398 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.446501 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.446686 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.446784 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.446992 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.447088 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.447291 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.447379 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.447594 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.447683 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.447899 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.447987 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.448210 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.448299 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.448519 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.448609 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.448815 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.448909 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.449123 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.449259 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.449430 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.449518 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.449748 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.449836 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.450058 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.450146 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.450429 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.450522 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.450698 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.450797 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.451014 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.451111 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.451328 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.451543 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.451638 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.451878 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.451965 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.452200 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.452291 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.452523 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.452610 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.453365 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.453472 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.453676 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.453964 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.454052 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.454285 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.454405 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.454621 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.454711 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.454949 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.455038 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.455270 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.455377 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.455588 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.455688 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.455898 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.455986 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.456214 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.456301 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.456521 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.456610 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.456828 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.456915 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.457136 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.457233 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.457444 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.457538 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.457753 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.457851 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.458062 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.458159 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.458386 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.458478 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.458700 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.458789 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.459008 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.459106 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.459308 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.459403 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.459618 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.459707 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.459935 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.460025 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.460243 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.460331 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.460546 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.460641 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.460848 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.460938 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.461156 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.461244 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.461458 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.461546 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.461764 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.461852 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.462064 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.462151 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.462401 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.462494 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.462693 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.462784 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.462996 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.463085 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.463299 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.463395 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.463598 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.463712 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.463899 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.464024 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.464199 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.464341 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.464500 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.464659 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.464806 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.464970 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.465108 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.465290 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.465444 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.465612 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.465700 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.465921 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.466010 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.466237 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.466326 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.466568 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.466670 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.466893 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.466990 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.467224 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.467318 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.467547 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.467635 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.467856 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.467953 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.468158 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.468245 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.469066 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.469166 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.469417 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.469666 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.469756 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.470032 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.470129 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.470347 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.470479 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.470684 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.470772 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.470991 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.471080 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.471296 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.471395 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.471606 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.471694 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.471911 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.471999 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.472215 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.472313 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.472518 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.472607 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.472822 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.472959 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.473129 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.473228 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.473431 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.473520 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.473730 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.473828 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.474031 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.474127 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.474331 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.474486 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.474656 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.474767 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.474959 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.475049 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.475265 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.475353 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.475567 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.475655 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.475868 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.475957 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.476166 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.476255 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.476466 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.476567 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.476764 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.476853 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.477089 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.477176 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.477399 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.477496 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.477707 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.477796 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.478022 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.478117 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.478327 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.478482 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.478671 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.478768 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.478980 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.479068 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.479294 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.479390 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.479612 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.479701 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.479923 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.480012 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.480234 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.480331 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.480563 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.480652 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.480874 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.480963 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.481180 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.481270 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.481488 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.481577 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.481795 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.481883 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.482102 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.482199 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.482344 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115003) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 19 15:36:26.482450 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.482745 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.483070 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.483374 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.483697 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.484059 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.484638 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.484964 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.485275 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.485603 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.485912 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.486224 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.486560 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.486869 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.487177 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.487490 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.487798 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.488106 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.488419 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.488732 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.489055 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.489376 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.489683 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.490003 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.490330 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.490698 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.491006 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.491346 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.491671 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.491983 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.492293 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.492594 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:36:26.492834 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=115002) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 19 15:36:26.544103 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: INFO dbcounter [None req-af8ebab4-78b0-4222-b626-aab945d23bb8 None None] Registered counter for database nova_api Jul 19 15:36:26.556656 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: INFO dbcounter [None req-75d02785-e130-447b-9342-2222a9d4b949 None None] Registered counter for database nova_api Jul 19 15:36:26.656739 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG oslo_db.sqlalchemy.engines [None req-af8ebab4-78b0-4222-b626-aab945d23bb8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115003) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 15:36:26.663299 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG dbcounter [-] [115003] Writer thread running {{(pid=115003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 15:36:26.670335 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG oslo_db.sqlalchemy.engines [None req-75d02785-e130-447b-9342-2222a9d4b949 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115002) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 15:36:26.677179 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG dbcounter [-] [115002] Writer thread running {{(pid=115002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 15:36:26.720520 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.context [None req-af8ebab4-78b0-4222-b626-aab945d23bb8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),daf180c5-09be-4981-8daf-984991910d73(cell1) {{(pid=115003) load_cells /opt/stack/nova/nova/context.py:464}} Jul 19 15:36:26.724425 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG oslo_concurrency.lockutils [None req-af8ebab4-78b0-4222-b626-aab945d23bb8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:26.726021 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG oslo_concurrency.lockutils [None req-af8ebab4-78b0-4222-b626-aab945d23bb8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:26.726847 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG oslo_concurrency.lockutils [None req-af8ebab4-78b0-4222-b626-aab945d23bb8 None None] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:26.728978 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG oslo_concurrency.lockutils [None req-af8ebab4-78b0-4222-b626-aab945d23bb8 None None] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:26.730965 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: INFO dbcounter [None req-af8ebab4-78b0-4222-b626-aab945d23bb8 None None] Registered counter for database nova_cell0 Jul 19 15:36:26.733735 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.context [None req-75d02785-e130-447b-9342-2222a9d4b949 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),daf180c5-09be-4981-8daf-984991910d73(cell1) {{(pid=115002) load_cells /opt/stack/nova/nova/context.py:464}} Jul 19 15:36:26.735030 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: INFO dbcounter [None req-af8ebab4-78b0-4222-b626-aab945d23bb8 None None] Registered counter for database nova_cell1 Jul 19 15:36:26.738224 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG oslo_concurrency.lockutils [None req-75d02785-e130-447b-9342-2222a9d4b949 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:26.739746 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG oslo_concurrency.lockutils [None req-75d02785-e130-447b-9342-2222a9d4b949 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:26.740544 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG oslo_concurrency.lockutils [None req-75d02785-e130-447b-9342-2222a9d4b949 None None] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:36:26.742670 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG oslo_db.sqlalchemy.engines [None req-af8ebab4-78b0-4222-b626-aab945d23bb8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115003) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 15:36:26.742822 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG oslo_concurrency.lockutils [None req-75d02785-e130-447b-9342-2222a9d4b949 None None] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=115002) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:36:26.744742 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: INFO dbcounter [None req-75d02785-e130-447b-9342-2222a9d4b949 None None] Registered counter for database nova_cell0 Jul 19 15:36:26.744933 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG oslo_db.sqlalchemy.engines [None req-af8ebab4-78b0-4222-b626-aab945d23bb8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115003) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 15:36:26.748641 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: INFO dbcounter [None req-75d02785-e130-447b-9342-2222a9d4b949 None None] Registered counter for database nova_cell1 Jul 19 15:36:26.749462 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG dbcounter [-] [115003] Writer thread running {{(pid=115003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 15:36:26.755267 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG dbcounter [-] [115003] Writer thread running {{(pid=115003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 15:36:26.756697 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG oslo_db.sqlalchemy.engines [None req-75d02785-e130-447b-9342-2222a9d4b949 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115002) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 15:36:26.760276 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG oslo_db.sqlalchemy.engines [None req-75d02785-e130-447b-9342-2222a9d4b949 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115002) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 15:36:26.762727 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG dbcounter [-] [115002] Writer thread running {{(pid=115002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 15:36:26.903530 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG dbcounter [-] [115002] Writer thread running {{(pid=115002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 15:36:26.907338 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: INFO dbcounter [None req-af8ebab4-78b0-4222-b626-aab945d23bb8 None None] Registered counter for database nova_cell0 Jul 19 15:36:26.913529 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: INFO dbcounter [None req-75d02785-e130-447b-9342-2222a9d4b949 None None] Registered counter for database nova_cell0 Jul 19 15:36:26.915911 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG oslo_db.sqlalchemy.engines [None req-af8ebab4-78b0-4222-b626-aab945d23bb8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115003) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 15:36:26.920284 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG dbcounter [-] [115003] Writer thread running {{(pid=115003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 15:36:26.922680 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG oslo_db.sqlalchemy.engines [None req-75d02785-e130-447b-9342-2222a9d4b949 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=115002) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 15:36:26.927118 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG dbcounter [-] [115002] Writer thread running {{(pid=115002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 15:36:27.263286 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: WARNING keystonemiddleware.auth_token [None req-75d02785-e130-447b-9342-2222a9d4b949 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 19 15:36:27.267307 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: WARNING keystonemiddleware.auth_token [None req-af8ebab4-78b0-4222-b626-aab945d23bb8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 19 15:36:27.271128 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: WARNING keystonemiddleware.auth_token [None req-75d02785-e130-447b-9342-2222a9d4b949 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 19 15:36:27.274726 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: WARNING keystonemiddleware.auth_token [None req-af8ebab4-78b0-4222-b626-aab945d23bb8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 19 15:36:27.617484 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: WARNING keystonemiddleware.auth_token [None req-75d02785-e130-447b-9342-2222a9d4b949 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 19 15:36:27.619752 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: WARNING keystonemiddleware.auth_token [None req-af8ebab4-78b0-4222-b626-aab945d23bb8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 19 15:36:27.623472 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: WARNING keystonemiddleware.auth_token [None req-75d02785-e130-447b-9342-2222a9d4b949 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 19 15:36:27.626442 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: WARNING keystonemiddleware.auth_token [None req-af8ebab4-78b0-4222-b626-aab945d23bb8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 19 15:36:27.629363 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55cfdf60e9c0 pid: 115002 (default app) Jul 19 15:36:27.631465 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi [None req-75d02785-e130-447b-9342-2222a9d4b949 None None] Calling method '>' {{(pid=115002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:36:27.631705 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55cfdf60e9c0 pid: 115003 (default app) Jul 19 15:36:27.632653 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: INFO nova.api.openstack.requestlog [None req-75d02785-e130-447b-9342-2222a9d4b949 None None] 10.222.0.64 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001734 Jul 19 15:36:27.633062 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: [pid: 115002|app: 0|req: 1/1] 10.222.0.64 () {50 vars in 788 bytes} [Tue Jul 19 15:36:27 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:37:44.458411 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi [None req-af8ebab4-78b0-4222-b626-aab945d23bb8 None None] Calling method '>' {{(pid=115003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:37:44.459616 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: INFO nova.api.openstack.requestlog [None req-af8ebab4-78b0-4222-b626-aab945d23bb8 None None] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001970 Jul 19 15:37:44.460202 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: [pid: 115003|app: 0|req: 1/2] 10.222.0.64 () {54 vars in 930 bytes} [Tue Jul 19 15:37:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:37:44.472593 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG dbcounter [-] [115002] Writing DB stats nova_api:SELECT=3 {{(pid=115002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:37:44.473487 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG dbcounter [-] [115002] Writing DB stats nova_cell0:SELECT=3 {{(pid=115002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:37:44.474253 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG dbcounter [-] [115002] Writing DB stats nova_cell1:SELECT=3 {{(pid=115002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:37:44.475200 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG dbcounter [-] [115002] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=115002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:37:45.363797 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi [None req-bc0c9f2a-871e-4915-ac9f-32836d2fad43 admin admin] Calling method '>' {{(pid=115002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:37:45.394771 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: INFO nova.api.openstack.requestlog [None req-bc0c9f2a-871e-4915-ac9f-32836d2fad43 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.928387 Jul 19 15:37:45.395537 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: [pid: 115002|app: 0|req: 2/3] 10.222.0.64 () {60 vars in 1291 bytes} [Tue Jul 19 15:37:44 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:37:47.692568 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi [None req-af8ebab4-78b0-4222-b626-aab945d23bb8 None None] Calling method '>' {{(pid=115003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:37:47.693590 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: INFO nova.api.openstack.requestlog [None req-af8ebab4-78b0-4222-b626-aab945d23bb8 None None] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Jul 19 15:37:47.694499 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: [pid: 115003|app: 0|req: 2/4] 10.222.0.64 () {54 vars in 930 bytes} [Tue Jul 19 15:37:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:37:48.146791 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi [None req-8d84c413-9a80-4235-b57d-05ffb7da4c3f admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "ram": 256, "rxtx_factor": 1.0, "id": "c1", "name": "cirros256", "vcpus": 1, "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=115002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:37:48.165294 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 15:37:48.165294 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: warnings.warn(msg) Jul 19 15:37:48.192376 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: INFO nova.api.openstack.requestlog [None req-8d84c413-9a80-4235-b57d-05ffb7da4c3f admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.492408 Jul 19 15:37:48.192925 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: [pid: 115002|app: 0|req: 3/5] 10.222.0.64 () {64 vars in 1282 bytes} [Tue Jul 19 15:37:47 2022] POST /compute/v2.1/flavors => generated 407 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 19 15:37:48.208008 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG dbcounter [-] [115003] Writing DB stats nova_api:SELECT=3 {{(pid=115003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:37:48.209240 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG dbcounter [-] [115003] Writing DB stats nova_cell0:SELECT=3 {{(pid=115003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:37:48.210499 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG dbcounter [-] [115003] Writing DB stats nova_cell1:SELECT=3 {{(pid=115003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:37:48.211363 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG dbcounter [-] [115003] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=115003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:37:48.440029 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi [None req-2d2bfe30-770e-4aa5-afb4-cd454eb48b5e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:37:48.442513 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 15:37:48.442513 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: warnings.warn(msg) Jul 19 15:37:48.517062 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: INFO nova.api.openstack.requestlog [None req-2d2bfe30-770e-4aa5-afb4-cd454eb48b5e admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.315652 Jul 19 15:37:48.517883 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: [pid: 115003|app: 0|req: 3/6] 10.222.0.64 () {64 vars in 1335 bytes} [Tue Jul 19 15:37:48 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:37:50.791126 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi [None req-8d84c413-9a80-4235-b57d-05ffb7da4c3f admin admin] Calling method '>' {{(pid=115002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:37:50.792146 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: INFO nova.api.openstack.requestlog [None req-8d84c413-9a80-4235-b57d-05ffb7da4c3f admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Jul 19 15:37:50.792798 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: [pid: 115002|app: 0|req: 4/7] 10.222.0.64 () {54 vars in 930 bytes} [Tue Jul 19 15:37:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:37:51.468426 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi [None req-ce1c6edd-8967-481a-8d05-b05efc98c471 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "vcpus": 1, "id": "d1", "name": "ds512M", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 512, "disk": 5}} {{(pid=115003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:37:51.487510 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 15:37:51.487510 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: warnings.warn(msg) Jul 19 15:37:51.510052 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: INFO nova.api.openstack.requestlog [None req-ce1c6edd-8967-481a-8d05-b05efc98c471 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.710598 Jul 19 15:37:51.511016 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: [pid: 115003|app: 0|req: 4/8] 10.222.0.64 () {64 vars in 1282 bytes} [Tue Jul 19 15:37:50 2022] POST /compute/v2.1/flavors => generated 404 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 15:37:51.524052 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi [None req-9f8249cb-221f-4e8f-b43c-05e5c4928dcc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:37:51.526147 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 15:37:51.526147 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: warnings.warn(msg) Jul 19 15:37:51.559591 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: INFO nova.api.openstack.requestlog [None req-9f8249cb-221f-4e8f-b43c-05e5c4928dcc admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039575 Jul 19 15:37:51.569472 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: [pid: 115002|app: 0|req: 5/9] 10.222.0.64 () {64 vars in 1335 bytes} [Tue Jul 19 15:37:51 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:37:53.847941 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi [None req-ce1c6edd-8967-481a-8d05-b05efc98c471 admin admin] Calling method '>' {{(pid=115003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:37:53.849052 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: INFO nova.api.openstack.requestlog [None req-ce1c6edd-8967-481a-8d05-b05efc98c471 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001611 Jul 19 15:37:53.849516 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: [pid: 115003|app: 0|req: 5/10] 10.222.0.64 () {54 vars in 930 bytes} [Tue Jul 19 15:37:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:37:54.241610 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi [None req-0d298064-4b08-4c21-978b-1fdf25855993 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "os-flavor-access:is_public": true, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "name": "ds1G", "ram": 1024}} {{(pid=115002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:37:54.259810 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: INFO nova.api.openstack.requestlog [None req-0d298064-4b08-4c21-978b-1fdf25855993 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.404249 Jul 19 15:37:54.260381 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: [pid: 115002|app: 0|req: 6/11] 10.222.0.64 () {64 vars in 1282 bytes} [Tue Jul 19 15:37:53 2022] POST /compute/v2.1/flavors => generated 404 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 15:37:54.273234 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi [None req-bf0447de-3ace-44cc-adb0-7acfc9ce7e74 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:37:54.295540 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: INFO nova.api.openstack.requestlog [None req-bf0447de-3ace-44cc-adb0-7acfc9ce7e74 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026069 Jul 19 15:37:54.296097 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: [pid: 115003|app: 0|req: 6/12] 10.222.0.64 () {64 vars in 1335 bytes} [Tue Jul 19 15:37:54 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:37:56.537786 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi [None req-0d298064-4b08-4c21-978b-1fdf25855993 admin admin] Calling method '>' {{(pid=115002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:37:56.538870 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: INFO nova.api.openstack.requestlog [None req-0d298064-4b08-4c21-978b-1fdf25855993 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001525 Jul 19 15:37:56.539355 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: [pid: 115002|app: 0|req: 7/13] 10.222.0.64 () {54 vars in 930 bytes} [Tue Jul 19 15:37:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:37:56.966201 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi [None req-0600161f-b89d-41ec-bb9d-2c4b28590b76 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "swap": 0, "vcpus": 2, "rxtx_factor": 1.0, "id": "d3", "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "os-flavor-access:is_public": true}} {{(pid=115003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:37:56.986678 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: INFO nova.api.openstack.requestlog [None req-0600161f-b89d-41ec-bb9d-2c4b28590b76 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.441516 Jul 19 15:37:56.987218 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: [pid: 115003|app: 0|req: 7/14] 10.222.0.64 () {64 vars in 1282 bytes} [Tue Jul 19 15:37:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 19 15:37:56.999581 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi [None req-527d7675-f060-4af0-b710-832fdba73952 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:37:57.021866 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: INFO nova.api.openstack.requestlog [None req-527d7675-f060-4af0-b710-832fdba73952 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026531 Jul 19 15:37:57.022773 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: [pid: 115002|app: 0|req: 8/15] 10.222.0.64 () {64 vars in 1335 bytes} [Tue Jul 19 15:37:56 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:37:59.296966 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi [None req-0600161f-b89d-41ec-bb9d-2c4b28590b76 admin admin] Calling method '>' {{(pid=115003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:37:59.297964 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: INFO nova.api.openstack.requestlog [None req-0600161f-b89d-41ec-bb9d-2c4b28590b76 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001617 Jul 19 15:37:59.298406 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: [pid: 115003|app: 0|req: 8/16] 10.222.0.64 () {54 vars in 930 bytes} [Tue Jul 19 15:37:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:37:59.729068 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi [None req-2170dbaa-aedd-4f69-913b-857bc98e488b admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 4, "rxtx_factor": 1.0, "name": "ds4G", "id": "d4", "disk": 20}} {{(pid=115002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:37:59.746838 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: INFO nova.api.openstack.requestlog [None req-2170dbaa-aedd-4f69-913b-857bc98e488b admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.442520 Jul 19 15:37:59.747496 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: [pid: 115002|app: 0|req: 9/17] 10.222.0.64 () {64 vars in 1282 bytes} [Tue Jul 19 15:37:59 2022] POST /compute/v2.1/flavors => generated 404 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 15:37:59.760696 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi [None req-83910c5c-2cac-4b00-a82c-8e81e037e0d8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:37:59.786793 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: INFO nova.api.openstack.requestlog [None req-83910c5c-2cac-4b00-a82c-8e81e037e0d8 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029518 Jul 19 15:37:59.795993 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: [pid: 115003|app: 0|req: 9/18] 10.222.0.64 () {64 vars in 1335 bytes} [Tue Jul 19 15:37:59 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:38:02.090907 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi [None req-2170dbaa-aedd-4f69-913b-857bc98e488b admin admin] Calling method '>' {{(pid=115002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:38:02.091904 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: INFO nova.api.openstack.requestlog [None req-2170dbaa-aedd-4f69-913b-857bc98e488b admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001479 Jul 19 15:38:02.092429 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: [pid: 115002|app: 0|req: 10/19] 10.222.0.64 () {54 vars in 930 bytes} [Tue Jul 19 15:38:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:38:02.537496 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi [None req-f052c438-e641-4355-b6f8-85ac3f1adbdb admin admin] Calling method '>' {{(pid=115003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:38:02.562290 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: INFO nova.api.openstack.requestlog [None req-f052c438-e641-4355-b6f8-85ac3f1adbdb admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.463720 Jul 19 15:38:02.562876 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: [pid: 115003|app: 0|req: 10/20] 10.222.0.64 () {60 vars in 1291 bytes} [Tue Jul 19 15:38:02 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:38:04.876804 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi [None req-2170dbaa-aedd-4f69-913b-857bc98e488b admin admin] Calling method '>' {{(pid=115002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:38:04.877854 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: INFO nova.api.openstack.requestlog [None req-2170dbaa-aedd-4f69-913b-857bc98e488b admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001550 Jul 19 15:38:04.878273 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: [pid: 115002|app: 0|req: 11/21] 10.222.0.64 () {54 vars in 930 bytes} [Tue Jul 19 15:38:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:38:05.336431 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi [None req-1891d26b-6e6a-4b54-a479-566ac85f2b81 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "rxtx_factor": 1.0, "disk": 1, "ram": 512, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1, "name": "m1.tiny"}} {{(pid=115003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:38:05.357155 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: INFO nova.api.openstack.requestlog [None req-1891d26b-6e6a-4b54-a479-566ac85f2b81 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.472387 Jul 19 15:38:05.358324 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: [pid: 115003|app: 0|req: 11/22] 10.222.0.64 () {64 vars in 1282 bytes} [Tue Jul 19 15:38:04 2022] POST /compute/v2.1/flavors => generated 402 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 19 15:38:05.372383 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi [None req-3653f7fa-16ee-41b7-ab84-8831bcb742d1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:38:05.398086 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: INFO nova.api.openstack.requestlog [None req-3653f7fa-16ee-41b7-ab84-8831bcb742d1 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029382 Jul 19 15:38:05.398731 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: [pid: 115002|app: 0|req: 12/23] 10.222.0.64 () {64 vars in 1332 bytes} [Tue Jul 19 15:38:05 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:38:07.783074 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi [None req-1891d26b-6e6a-4b54-a479-566ac85f2b81 admin admin] Calling method '>' {{(pid=115003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:38:07.784215 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: INFO nova.api.openstack.requestlog [None req-1891d26b-6e6a-4b54-a479-566ac85f2b81 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001607 Jul 19 15:38:07.784634 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: [pid: 115003|app: 0|req: 12/24] 10.222.0.64 () {54 vars in 930 bytes} [Tue Jul 19 15:38:07 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:38:08.189460 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi [None req-9b9a4454-5fab-4dee-8d72-c44df3852e45 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "id": "2", "rxtx_factor": 1.0, "ram": 2048, "vcpus": 1, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "os-flavor-access:is_public": true}} {{(pid=115002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:38:08.208129 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: INFO nova.api.openstack.requestlog [None req-9b9a4454-5fab-4dee-8d72-c44df3852e45 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.417666 Jul 19 15:38:08.208683 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: [pid: 115002|app: 0|req: 13/25] 10.222.0.64 () {64 vars in 1282 bytes} [Tue Jul 19 15:38:07 2022] POST /compute/v2.1/flavors => generated 405 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 19 15:38:08.222139 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi [None req-53768c7a-5477-4599-8628-c2c7fa2e1d7d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:38:08.248038 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: INFO nova.api.openstack.requestlog [None req-53768c7a-5477-4599-8628-c2c7fa2e1d7d admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031149 Jul 19 15:38:08.254398 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: [pid: 115003|app: 0|req: 13/26] 10.222.0.64 () {64 vars in 1332 bytes} [Tue Jul 19 15:38:08 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:38:10.507252 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi [None req-9b9a4454-5fab-4dee-8d72-c44df3852e45 admin admin] Calling method '>' {{(pid=115002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:38:10.508336 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: INFO nova.api.openstack.requestlog [None req-9b9a4454-5fab-4dee-8d72-c44df3852e45 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001517 Jul 19 15:38:10.509001 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: [pid: 115002|app: 0|req: 14/27] 10.222.0.64 () {54 vars in 930 bytes} [Tue Jul 19 15:38:10 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:38:10.925759 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi [None req-837d8f8c-051e-4d6b-ae49-daef9f171f34 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "rxtx_factor": 1.0, "swap": 0, "name": "m1.medium", "id": "3", "ram": 4096, "disk": 40, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=115003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:38:10.945295 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: INFO nova.api.openstack.requestlog [None req-837d8f8c-051e-4d6b-ae49-daef9f171f34 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.429894 Jul 19 15:38:10.946146 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: [pid: 115003|app: 0|req: 14/28] 10.222.0.64 () {64 vars in 1282 bytes} [Tue Jul 19 15:38:10 2022] POST /compute/v2.1/flavors => generated 406 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 19 15:38:10.959064 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi [None req-efa663de-f102-4e8f-ad9b-fb04818e0d5d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:38:10.982030 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: INFO nova.api.openstack.requestlog [None req-efa663de-f102-4e8f-ad9b-fb04818e0d5d admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026890 Jul 19 15:38:10.982691 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: [pid: 115002|app: 0|req: 15/29] 10.222.0.64 () {64 vars in 1332 bytes} [Tue Jul 19 15:38:10 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:38:13.297088 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi [None req-837d8f8c-051e-4d6b-ae49-daef9f171f34 admin admin] Calling method '>' {{(pid=115003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:38:13.298983 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: INFO nova.api.openstack.requestlog [None req-837d8f8c-051e-4d6b-ae49-daef9f171f34 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002282 Jul 19 15:38:13.299604 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: [pid: 115003|app: 0|req: 15/30] 10.222.0.64 () {54 vars in 930 bytes} [Tue Jul 19 15:38:13 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:38:13.745545 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi [None req-66f846d8-edf8-403f-9993-c59537ea7491 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 8192, "disk": 80, "os-flavor-access:is_public": true, "name": "m1.large", "vcpus": 4}} {{(pid=115002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:38:13.766652 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: INFO nova.api.openstack.requestlog [None req-66f846d8-edf8-403f-9993-c59537ea7491 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.461037 Jul 19 15:38:13.767923 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: [pid: 115002|app: 0|req: 16/31] 10.222.0.64 () {64 vars in 1282 bytes} [Tue Jul 19 15:38:13 2022] POST /compute/v2.1/flavors => generated 405 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 15:38:13.780297 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi [None req-2bf6fa9d-95f3-4d65-abb3-abc6fc6caa4d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:38:13.807893 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: INFO nova.api.openstack.requestlog [None req-2bf6fa9d-95f3-4d65-abb3-abc6fc6caa4d admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032313 Jul 19 15:38:13.808636 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: [pid: 115003|app: 0|req: 16/32] 10.222.0.64 () {64 vars in 1332 bytes} [Tue Jul 19 15:38:13 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:38:16.070195 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi [None req-66f846d8-edf8-403f-9993-c59537ea7491 admin admin] Calling method '>' {{(pid=115002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:38:16.071250 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: INFO nova.api.openstack.requestlog [None req-66f846d8-edf8-403f-9993-c59537ea7491 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Jul 19 15:38:16.071878 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: [pid: 115002|app: 0|req: 17/33] 10.222.0.64 () {54 vars in 930 bytes} [Tue Jul 19 15:38:16 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:38:16.555852 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi [None req-9242b844-4b06-4301-9e28-b0a558dd0212 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "5", "disk": 160, "swap": 0, "name": "m1.xlarge", "ram": 16384, "vcpus": 8}} {{(pid=115003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:38:16.581330 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: INFO nova.api.openstack.requestlog [None req-9242b844-4b06-4301-9e28-b0a558dd0212 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.503062 Jul 19 15:38:16.586819 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: [pid: 115003|app: 0|req: 17/34] 10.222.0.64 () {64 vars in 1282 bytes} [Tue Jul 19 15:38:16 2022] POST /compute/v2.1/flavors => generated 408 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 15:38:16.597226 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi [None req-33f32366-924b-4929-b361-a990d35c0b6c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=115002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:38:16.600920 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG dbcounter [-] [115002] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=9,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=115002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:38:16.630916 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: INFO nova.api.openstack.requestlog [None req-33f32366-924b-4929-b361-a990d35c0b6c admin admin] 10.222.0.64 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.040510 Jul 19 15:38:16.631513 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: [pid: 115002|app: 0|req: 18/35] 10.222.0.64 () {64 vars in 1332 bytes} [Tue Jul 19 15:38:16 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:38:36.487543 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi [None req-9242b844-4b06-4301-9e28-b0a558dd0212 admin admin] Calling method '>' {{(pid=115003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:38:36.489210 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: INFO nova.api.openstack.requestlog [None req-9242b844-4b06-4301-9e28-b0a558dd0212 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001839 Jul 19 15:38:36.489610 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: [pid: 115003|app: 0|req: 18/36] 10.222.0.64 () {54 vars in 930 bytes} [Tue Jul 19 15:38:36 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 15:38:36.942423 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi [None req-c5345d7e-67a6-4d45-b334-863347a56239 admin admin] Calling method '>' {{(pid=115002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:38:36.961514 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: INFO nova.api.openstack.requestlog [None req-c5345d7e-67a6-4d45-b334-863347a56239 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.465312 Jul 19 15:38:36.962070 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: [pid: 115002|app: 0|req: 19/37] 10.222.0.64 () {60 vars in 1291 bytes} [Tue Jul 19 15:38:36 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:38:38.055379 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi [None req-9242b844-4b06-4301-9e28-b0a558dd0212 admin admin] Calling method '>' {{(pid=115003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:38:38.056372 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: INFO nova.api.openstack.requestlog [None req-9242b844-4b06-4301-9e28-b0a558dd0212 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001405 Jul 19 15:38:38.056761 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: [pid: 115003|app: 0|req: 19/38] 10.222.0.64 () {56 vars in 1074 bytes} [Tue Jul 19 15:38:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:38:38.594376 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi [None req-1cfa93a6-8d52-4ea7-b932-227c3d9626a7 admin admin] Calling method '>' {{(pid=115002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:38:38.600038 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: INFO nova.api.openstack.wsgi [None req-1cfa93a6-8d52-4ea7-b932-227c3d9626a7 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 19 15:38:38.603301 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi [None req-1cfa93a6-8d52-4ea7-b932-227c3d9626a7 admin admin] Request method failure captured: Jul 19 15:38:38.603301 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 19 15:38:38.603301 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: Accept: application/json Jul 19 15:38:38.603301 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: Accept-Encoding: gzip, deflate Jul 19 15:38:38.603301 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: Connection: keep-alive Jul 19 15:38:38.603301 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: Content-Length: 0 Jul 19 15:38:38.603301 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: Host: 10.222.0.64 Jul 19 15:38:38.603301 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: Openstack-Api-Version: compute 2.90 Jul 19 15:38:38.603301 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: Openstack-System-Scope: None Jul 19 15:38:38.603301 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: User-Agent: python-novaclient Jul 19 15:38:38.603301 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: X-Auth-Token: gAAAAABi1s_95zDG5vSW7zyGH5Zn-hwzg9VDtDMAImylSywBGoWMJh8Z8Z3TEtt70ciNILFSBJrin3ILyVu1jSOqkkRSFxfv1vkaZ9hsD1WhMkFSJCU3qfhXY_FMJcVsPHcLSn-tZG18l0ly_aoFEdOtY55iMxL7Ld4tTemAErEXp1moFreUcfk Jul 19 15:38:38.603301 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: X-Domain-Id: None Jul 19 15:38:38.603301 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: X-Domain-Name: None Jul 19 15:38:38.603301 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: X-Identity-Status: Confirmed Jul 19 15:38:38.603301 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: X-Is-Admin-Project: True Jul 19 15:38:38.603301 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: X-Openstack-Nova-Api-Version: 2.90 Jul 19 15:38:38.603301 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: X-Project-Domain-Id: default Jul 19 15:38:38.603301 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: X-Project-Domain-Name: Default Jul 19 15:38:38.603301 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: X-Project-Id: 6a28683ac9174fb4a8e11a5ac75df07c Jul 19 15:38:38.603301 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: X-Project-Name: admin Jul 19 15:38:38.603301 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: X-Role: admin,member,reader Jul 19 15:38:38.603301 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: X-Roles: admin,member,reader Jul 19 15:38:38.605028 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_6a28683ac9174fb4a8e11a5ac75df07c", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6a28683ac9174fb4a8e11a5ac75df07c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6a28683ac9174fb4a8e11a5ac75df07c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/6a28683ac9174fb4a8e11a5ac75df07c"}]}] Jul 19 15:38:38.605028 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: X-Tenant: admin Jul 19 15:38:38.605028 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: X-Tenant-Id: 6a28683ac9174fb4a8e11a5ac75df07c Jul 19 15:38:38.605028 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: X-Tenant-Name: admin Jul 19 15:38:38.605028 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: X-User: admin Jul 19 15:38:38.605028 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: X-User-Domain-Id: default Jul 19 15:38:38.605028 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: X-User-Domain-Name: Default Jul 19 15:38:38.605028 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: X-User-Id: dc78df0f6ac445d5b0a04a3f9969c79f Jul 19 15:38:38.605028 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: X-User-Name: admin Jul 19 15:38:38.605028 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: method: > Jul 19 15:38:38.605028 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: exception: Flavor 42 could not be found. Jul 19 15:38:38.605028 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: action_args: {'id': '42'} Jul 19 15:38:38.605028 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: {{(pid=115002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:38:38.605028 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:38:38.607710 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 19 15:38:38.607710 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 19 15:38:38.607710 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 19 15:38:38.607710 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 19 15:38:38.607710 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 15:38:38.607710 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 15:38:38.607710 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 19 15:38:38.607710 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 19 15:38:38.607710 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 19 15:38:38.607710 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:38:38.607710 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 19 15:38:38.607710 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 19 15:38:38.607710 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 19 15:38:38.607710 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: ERROR nova.api.openstack.wsgi Jul 19 15:38:38.607710 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:38:38.607710 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: ERROR nova.api.openstack.wsgi Jul 19 15:38:38.607710 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:38:38.607710 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:38:38.607710 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:38:38.609149 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:38:38.609149 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:38:38.609149 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:38:38.609149 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:38:38.609149 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 19 15:38:38.609149 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 19 15:38:38.609149 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 19 15:38:38.609149 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: ERROR nova.api.openstack.wsgi Jul 19 15:38:38.609149 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:38:38.609149 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: ERROR nova.api.openstack.wsgi Jul 19 15:38:38.609149 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:38:38.609149 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:38:38.609149 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:38:38.609149 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:38:38.609149 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:38:38.609149 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 19 15:38:38.609149 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: ERROR nova.api.openstack.wsgi Jul 19 15:38:38.609149 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi [None req-1cfa93a6-8d52-4ea7-b932-227c3d9626a7 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=115002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:38:38.610458 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: INFO nova.api.openstack.requestlog [None req-1cfa93a6-8d52-4ea7-b932-227c3d9626a7 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.407367 Jul 19 15:38:38.610458 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: [pid: 115002|app: 0|req: 20/39] 10.222.0.64 () {60 vars in 1190 bytes} [Tue Jul 19 15:38:38 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 408 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jul 19 15:38:38.615297 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi [None req-17e977d5-6ffa-4d7d-8c8f-0068d1a378bb admin admin] Calling method '>' {{(pid=115003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:38:38.618336 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG dbcounter [-] [115003] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=115003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:38:38.638172 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: INFO nova.api.openstack.requestlog [None req-17e977d5-6ffa-4d7d-8c8f-0068d1a378bb admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026405 Jul 19 15:38:38.638948 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: [pid: 115003|app: 0|req: 20/40] 10.222.0.64 () {60 vars in 1210 bytes} [Tue Jul 19 15:38:38 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 15:38:38.648448 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi [None req-71ec5548-4b4e-4881-b417-3e569f915130 admin admin] Calling method '>' {{(pid=115002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:38:38.669888 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: INFO nova.api.openstack.requestlog [None req-71ec5548-4b4e-4881-b417-3e569f915130 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024888 Jul 19 15:38:38.671026 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: [pid: 115002|app: 0|req: 21/41] 10.222.0.64 () {60 vars in 1210 bytes} [Tue Jul 19 15:38:38 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:38:38.681805 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi [None req-bb6d475a-f2a0-4698-bda8-544e4a0d4693 admin admin] Calling method '>' {{(pid=115003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:38:38.688453 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: INFO nova.api.openstack.wsgi [None req-bb6d475a-f2a0-4698-bda8-544e4a0d4693 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 19 15:38:38.691709 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi [None req-bb6d475a-f2a0-4698-bda8-544e4a0d4693 admin admin] Request method failure captured: Jul 19 15:38:38.691709 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 19 15:38:38.691709 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: Accept: application/json Jul 19 15:38:38.691709 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: Accept-Encoding: gzip, deflate Jul 19 15:38:38.691709 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: Connection: keep-alive Jul 19 15:38:38.691709 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: Content-Length: 0 Jul 19 15:38:38.691709 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: Host: 10.222.0.64 Jul 19 15:38:38.691709 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: Openstack-Api-Version: compute 2.90 Jul 19 15:38:38.691709 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: Openstack-System-Scope: None Jul 19 15:38:38.691709 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: User-Agent: python-novaclient Jul 19 15:38:38.691709 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: X-Auth-Token: gAAAAABi1s_95zDG5vSW7zyGH5Zn-hwzg9VDtDMAImylSywBGoWMJh8Z8Z3TEtt70ciNILFSBJrin3ILyVu1jSOqkkRSFxfv1vkaZ9hsD1WhMkFSJCU3qfhXY_FMJcVsPHcLSn-tZG18l0ly_aoFEdOtY55iMxL7Ld4tTemAErEXp1moFreUcfk Jul 19 15:38:38.691709 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: X-Domain-Id: None Jul 19 15:38:38.691709 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: X-Domain-Name: None Jul 19 15:38:38.691709 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: X-Identity-Status: Confirmed Jul 19 15:38:38.691709 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: X-Is-Admin-Project: True Jul 19 15:38:38.691709 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: X-Openstack-Nova-Api-Version: 2.90 Jul 19 15:38:38.691709 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: X-Project-Domain-Id: default Jul 19 15:38:38.691709 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: X-Project-Domain-Name: Default Jul 19 15:38:38.691709 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: X-Project-Id: 6a28683ac9174fb4a8e11a5ac75df07c Jul 19 15:38:38.691709 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: X-Project-Name: admin Jul 19 15:38:38.691709 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: X-Role: admin,member,reader Jul 19 15:38:38.691709 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: X-Roles: admin,member,reader Jul 19 15:38:38.693284 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_6a28683ac9174fb4a8e11a5ac75df07c", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6a28683ac9174fb4a8e11a5ac75df07c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6a28683ac9174fb4a8e11a5ac75df07c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/6a28683ac9174fb4a8e11a5ac75df07c"}]}] Jul 19 15:38:38.693284 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: X-Tenant: admin Jul 19 15:38:38.693284 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: X-Tenant-Id: 6a28683ac9174fb4a8e11a5ac75df07c Jul 19 15:38:38.693284 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: X-Tenant-Name: admin Jul 19 15:38:38.693284 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: X-User: admin Jul 19 15:38:38.693284 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: X-User-Domain-Id: default Jul 19 15:38:38.693284 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: X-User-Domain-Name: Default Jul 19 15:38:38.693284 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: X-User-Id: dc78df0f6ac445d5b0a04a3f9969c79f Jul 19 15:38:38.693284 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: X-User-Name: admin Jul 19 15:38:38.693284 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: method: > Jul 19 15:38:38.693284 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: exception: Flavor 42 could not be found. Jul 19 15:38:38.693284 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: action_args: {'id': '42'} Jul 19 15:38:38.693284 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: {{(pid=115003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:38:38.693284 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:38:38.694538 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 19 15:38:38.694538 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 19 15:38:38.694538 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 19 15:38:38.694538 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 19 15:38:38.694538 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 15:38:38.694538 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 15:38:38.694538 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 19 15:38:38.694538 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 19 15:38:38.694538 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 19 15:38:38.694538 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:38:38.694538 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 19 15:38:38.694538 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 19 15:38:38.694538 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 19 15:38:38.694538 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: ERROR nova.api.openstack.wsgi Jul 19 15:38:38.694538 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:38:38.694538 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: ERROR nova.api.openstack.wsgi Jul 19 15:38:38.694538 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:38:38.694538 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:38:38.694538 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:38:38.695858 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:38:38.695858 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:38:38.695858 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:38:38.695858 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:38:38.695858 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 19 15:38:38.695858 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 19 15:38:38.695858 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 19 15:38:38.695858 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: ERROR nova.api.openstack.wsgi Jul 19 15:38:38.695858 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:38:38.695858 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: ERROR nova.api.openstack.wsgi Jul 19 15:38:38.695858 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:38:38.695858 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:38:38.695858 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:38:38.695858 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:38:38.695858 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:38:38.695858 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 19 15:38:38.695858 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: ERROR nova.api.openstack.wsgi Jul 19 15:38:38.695858 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi [None req-bb6d475a-f2a0-4698-bda8-544e4a0d4693 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=115003) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:38:38.697092 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: INFO nova.api.openstack.requestlog [None req-bb6d475a-f2a0-4698-bda8-544e4a0d4693 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015445 Jul 19 15:38:38.697092 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: [pid: 115003|app: 0|req: 21/42] 10.222.0.64 () {60 vars in 1190 bytes} [Tue Jul 19 15:38:38 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 17 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 19 15:38:39.671659 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi [None req-71ec5548-4b4e-4881-b417-3e569f915130 admin admin] Calling method '>' {{(pid=115002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:38:39.672699 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: INFO nova.api.openstack.requestlog [None req-71ec5548-4b4e-4881-b417-3e569f915130 admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001501 Jul 19 15:38:39.673112 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: [pid: 115002|app: 0|req: 22/43] 10.222.0.64 () {56 vars in 1074 bytes} [Tue Jul 19 15:38:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:38:40.197368 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi [None req-258a52a0-ef2f-4e9a-bc14-1a4b5c3da134 admin admin] Calling method '>' {{(pid=115003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:38:40.203521 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: INFO nova.api.openstack.wsgi [None req-258a52a0-ef2f-4e9a-bc14-1a4b5c3da134 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 19 15:38:40.205036 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi [None req-258a52a0-ef2f-4e9a-bc14-1a4b5c3da134 admin admin] Request method failure captured: Jul 19 15:38:40.205036 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 19 15:38:40.205036 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: Accept: application/json Jul 19 15:38:40.205036 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: Accept-Encoding: gzip, deflate Jul 19 15:38:40.205036 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: Connection: keep-alive Jul 19 15:38:40.205036 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: Content-Length: 0 Jul 19 15:38:40.205036 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: Host: 10.222.0.64 Jul 19 15:38:40.205036 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: Openstack-Api-Version: compute 2.90 Jul 19 15:38:40.205036 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: Openstack-System-Scope: None Jul 19 15:38:40.205036 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: User-Agent: python-novaclient Jul 19 15:38:40.205036 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: X-Auth-Token: gAAAAABi1s__vMM15m5AHTcv9CAHqfCgI0Wbwx97enB4vg9eiw-8SsltHp_QMott0kcvfvAy426xos-WXO6qwy0Byb66BLq4mLhknRAGnzLEmWjJNpekZP-GggeKl2WWtFKqjbycugy5C5YCxB6UN9VkTsxjbs9lF9BvLpV6lOPij7lEFitxtaI Jul 19 15:38:40.205036 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: X-Domain-Id: None Jul 19 15:38:40.205036 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: X-Domain-Name: None Jul 19 15:38:40.205036 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: X-Identity-Status: Confirmed Jul 19 15:38:40.205036 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: X-Is-Admin-Project: True Jul 19 15:38:40.205036 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: X-Openstack-Nova-Api-Version: 2.90 Jul 19 15:38:40.205036 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: X-Project-Domain-Id: default Jul 19 15:38:40.205036 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: X-Project-Domain-Name: Default Jul 19 15:38:40.205036 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: X-Project-Id: 6a28683ac9174fb4a8e11a5ac75df07c Jul 19 15:38:40.205036 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: X-Project-Name: admin Jul 19 15:38:40.205036 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: X-Role: admin,member,reader Jul 19 15:38:40.205036 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: X-Roles: admin,member,reader Jul 19 15:38:40.206461 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_6a28683ac9174fb4a8e11a5ac75df07c", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6a28683ac9174fb4a8e11a5ac75df07c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6a28683ac9174fb4a8e11a5ac75df07c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/6a28683ac9174fb4a8e11a5ac75df07c"}]}] Jul 19 15:38:40.206461 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: X-Tenant: admin Jul 19 15:38:40.206461 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: X-Tenant-Id: 6a28683ac9174fb4a8e11a5ac75df07c Jul 19 15:38:40.206461 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: X-Tenant-Name: admin Jul 19 15:38:40.206461 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: X-User: admin Jul 19 15:38:40.206461 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: X-User-Domain-Id: default Jul 19 15:38:40.206461 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: X-User-Domain-Name: Default Jul 19 15:38:40.206461 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: X-User-Id: dc78df0f6ac445d5b0a04a3f9969c79f Jul 19 15:38:40.206461 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: X-User-Name: admin Jul 19 15:38:40.206461 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: method: > Jul 19 15:38:40.206461 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: exception: Flavor 84 could not be found. Jul 19 15:38:40.206461 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: action_args: {'id': '84'} Jul 19 15:38:40.206461 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: {{(pid=115003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:38:40.206461 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:38:40.207295 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 19 15:38:40.207295 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 19 15:38:40.207295 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 19 15:38:40.207295 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 19 15:38:40.207295 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 15:38:40.207295 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 15:38:40.207295 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 19 15:38:40.207295 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 19 15:38:40.207295 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 19 15:38:40.207295 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:38:40.207295 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 19 15:38:40.207295 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 19 15:38:40.207295 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 19 15:38:40.207295 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: ERROR nova.api.openstack.wsgi Jul 19 15:38:40.207295 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:38:40.207295 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: ERROR nova.api.openstack.wsgi Jul 19 15:38:40.207295 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:38:40.207295 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:38:40.207295 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:38:40.208572 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:38:40.208572 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:38:40.208572 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:38:40.208572 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:38:40.208572 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 19 15:38:40.208572 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 19 15:38:40.208572 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 19 15:38:40.208572 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: ERROR nova.api.openstack.wsgi Jul 19 15:38:40.208572 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:38:40.208572 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: ERROR nova.api.openstack.wsgi Jul 19 15:38:40.208572 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:38:40.208572 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:38:40.208572 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:38:40.208572 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:38:40.208572 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:38:40.208572 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 19 15:38:40.208572 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: ERROR nova.api.openstack.wsgi Jul 19 15:38:40.208572 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi [None req-258a52a0-ef2f-4e9a-bc14-1a4b5c3da134 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=115003) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:38:40.210020 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: INFO nova.api.openstack.requestlog [None req-258a52a0-ef2f-4e9a-bc14-1a4b5c3da134 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.396702 Jul 19 15:38:40.210484 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: [pid: 115003|app: 0|req: 22/44] 10.222.0.64 () {60 vars in 1190 bytes} [Tue Jul 19 15:38:39 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 401 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 19 15:38:40.216280 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi [None req-6eca106f-37ca-4eb2-a2de-6318084d554c admin admin] Calling method '>' {{(pid=115002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:38:40.229700 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: INFO nova.api.openstack.requestlog [None req-6eca106f-37ca-4eb2-a2de-6318084d554c admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016989 Jul 19 15:38:40.230270 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: [pid: 115002|app: 0|req: 23/45] 10.222.0.64 () {60 vars in 1210 bytes} [Tue Jul 19 15:38:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:38:40.239885 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi [None req-dd7e3039-d8a6-4ef5-8707-72d8faac0f4f admin admin] Calling method '>' {{(pid=115003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:38:40.254100 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: INFO nova.api.openstack.requestlog [None req-dd7e3039-d8a6-4ef5-8707-72d8faac0f4f admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017774 Jul 19 15:38:40.254663 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: [pid: 115003|app: 0|req: 23/46] 10.222.0.64 () {60 vars in 1210 bytes} [Tue Jul 19 15:38:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 15:38:40.264463 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi [None req-bbd48cd4-1da0-4f19-bb6c-2538c414d078 admin admin] Calling method '>' {{(pid=115002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:38:40.269759 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: INFO nova.api.openstack.wsgi [None req-bbd48cd4-1da0-4f19-bb6c-2538c414d078 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 19 15:38:40.271275 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi [None req-bbd48cd4-1da0-4f19-bb6c-2538c414d078 admin admin] Request method failure captured: Jul 19 15:38:40.271275 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 19 15:38:40.271275 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: Accept: application/json Jul 19 15:38:40.271275 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: Accept-Encoding: gzip, deflate Jul 19 15:38:40.271275 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: Connection: keep-alive Jul 19 15:38:40.271275 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: Content-Length: 0 Jul 19 15:38:40.271275 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: Host: 10.222.0.64 Jul 19 15:38:40.271275 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: Openstack-Api-Version: compute 2.90 Jul 19 15:38:40.271275 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: Openstack-System-Scope: None Jul 19 15:38:40.271275 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: User-Agent: python-novaclient Jul 19 15:38:40.271275 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: X-Auth-Token: gAAAAABi1s__vMM15m5AHTcv9CAHqfCgI0Wbwx97enB4vg9eiw-8SsltHp_QMott0kcvfvAy426xos-WXO6qwy0Byb66BLq4mLhknRAGnzLEmWjJNpekZP-GggeKl2WWtFKqjbycugy5C5YCxB6UN9VkTsxjbs9lF9BvLpV6lOPij7lEFitxtaI Jul 19 15:38:40.271275 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: X-Domain-Id: None Jul 19 15:38:40.271275 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: X-Domain-Name: None Jul 19 15:38:40.271275 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: X-Identity-Status: Confirmed Jul 19 15:38:40.271275 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: X-Is-Admin-Project: True Jul 19 15:38:40.271275 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: X-Openstack-Nova-Api-Version: 2.90 Jul 19 15:38:40.271275 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: X-Project-Domain-Id: default Jul 19 15:38:40.271275 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: X-Project-Domain-Name: Default Jul 19 15:38:40.271275 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: X-Project-Id: 6a28683ac9174fb4a8e11a5ac75df07c Jul 19 15:38:40.271275 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: X-Project-Name: admin Jul 19 15:38:40.271275 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: X-Role: admin,member,reader Jul 19 15:38:40.271275 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: X-Roles: admin,member,reader Jul 19 15:38:40.272822 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_6a28683ac9174fb4a8e11a5ac75df07c", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6a28683ac9174fb4a8e11a5ac75df07c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6a28683ac9174fb4a8e11a5ac75df07c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/6a28683ac9174fb4a8e11a5ac75df07c"}]}] Jul 19 15:38:40.272822 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: X-Tenant: admin Jul 19 15:38:40.272822 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: X-Tenant-Id: 6a28683ac9174fb4a8e11a5ac75df07c Jul 19 15:38:40.272822 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: X-Tenant-Name: admin Jul 19 15:38:40.272822 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: X-User: admin Jul 19 15:38:40.272822 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: X-User-Domain-Id: default Jul 19 15:38:40.272822 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: X-User-Domain-Name: Default Jul 19 15:38:40.272822 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: X-User-Id: dc78df0f6ac445d5b0a04a3f9969c79f Jul 19 15:38:40.272822 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: X-User-Name: admin Jul 19 15:38:40.272822 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: method: > Jul 19 15:38:40.272822 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: exception: Flavor 84 could not be found. Jul 19 15:38:40.272822 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: action_args: {'id': '84'} Jul 19 15:38:40.272822 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: {{(pid=115002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:38:40.272822 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:38:40.273805 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 19 15:38:40.273805 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 19 15:38:40.273805 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 19 15:38:40.273805 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 19 15:38:40.273805 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 15:38:40.273805 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 15:38:40.273805 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 19 15:38:40.273805 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 19 15:38:40.273805 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 19 15:38:40.273805 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:38:40.273805 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 19 15:38:40.273805 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 19 15:38:40.273805 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 19 15:38:40.273805 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: ERROR nova.api.openstack.wsgi Jul 19 15:38:40.273805 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:38:40.273805 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: ERROR nova.api.openstack.wsgi Jul 19 15:38:40.273805 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:38:40.273805 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:38:40.273805 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:38:40.275246 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:38:40.275246 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:38:40.275246 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:38:40.275246 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:38:40.275246 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 19 15:38:40.275246 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 19 15:38:40.275246 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 19 15:38:40.275246 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: ERROR nova.api.openstack.wsgi Jul 19 15:38:40.275246 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:38:40.275246 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: ERROR nova.api.openstack.wsgi Jul 19 15:38:40.275246 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:38:40.275246 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:38:40.275246 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:38:40.275246 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:38:40.275246 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:38:40.275246 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 19 15:38:40.275246 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: ERROR nova.api.openstack.wsgi Jul 19 15:38:40.275246 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi [None req-bbd48cd4-1da0-4f19-bb6c-2538c414d078 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=115002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:38:40.276468 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: INFO nova.api.openstack.requestlog [None req-bbd48cd4-1da0-4f19-bb6c-2538c414d078 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012486 Jul 19 15:38:40.276468 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: [pid: 115002|app: 0|req: 24/47] 10.222.0.64 () {60 vars in 1190 bytes} [Tue Jul 19 15:38:40 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 19 15:38:41.249923 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi [None req-dd7e3039-d8a6-4ef5-8707-72d8faac0f4f admin admin] Calling method '>' {{(pid=115003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:38:41.250954 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: INFO nova.api.openstack.requestlog [None req-dd7e3039-d8a6-4ef5-8707-72d8faac0f4f admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Jul 19 15:38:41.251341 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: [pid: 115003|app: 0|req: 24/48] 10.222.0.64 () {56 vars in 1074 bytes} [Tue Jul 19 15:38:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:38:41.774917 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi [None req-4bbf7b9a-c037-4ad6-b95f-e86b0f9147da admin admin] Calling method '>' {{(pid=115002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:38:41.781504 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: INFO nova.api.openstack.wsgi [None req-4bbf7b9a-c037-4ad6-b95f-e86b0f9147da admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 19 15:38:41.783015 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi [None req-4bbf7b9a-c037-4ad6-b95f-e86b0f9147da admin admin] Request method failure captured: Jul 19 15:38:41.783015 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 19 15:38:41.783015 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: Accept: application/json Jul 19 15:38:41.783015 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: Accept-Encoding: gzip, deflate Jul 19 15:38:41.783015 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: Connection: keep-alive Jul 19 15:38:41.783015 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: Content-Length: 0 Jul 19 15:38:41.783015 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: Host: 10.222.0.64 Jul 19 15:38:41.783015 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: Openstack-Api-Version: compute 2.90 Jul 19 15:38:41.783015 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: Openstack-System-Scope: None Jul 19 15:38:41.783015 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: User-Agent: python-novaclient Jul 19 15:38:41.783015 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: X-Auth-Token: gAAAAABi1tAB2TmbgN9cKNtJLZ9_gctiS9nGlD1kLTchZOeK4WCMLuyN_cgPH9HPwGurw5ODwtqmoyBGpqFHkmY635_KB1jf_zgmfk4jacZLeKr6b-qOW6zf0oYzs2e-WOXfkwjjfjp6gZLlyiWrMvLuOOco5BXAnt8TrKu7XK6T6xYsB23cDT0 Jul 19 15:38:41.783015 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: X-Domain-Id: None Jul 19 15:38:41.783015 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: X-Domain-Name: None Jul 19 15:38:41.783015 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: X-Identity-Status: Confirmed Jul 19 15:38:41.783015 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: X-Is-Admin-Project: True Jul 19 15:38:41.783015 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: X-Openstack-Nova-Api-Version: 2.90 Jul 19 15:38:41.783015 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: X-Project-Domain-Id: default Jul 19 15:38:41.783015 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: X-Project-Domain-Name: Default Jul 19 15:38:41.783015 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: X-Project-Id: 6a28683ac9174fb4a8e11a5ac75df07c Jul 19 15:38:41.783015 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: X-Project-Name: admin Jul 19 15:38:41.783015 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: X-Role: admin,member,reader Jul 19 15:38:41.783015 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: X-Roles: admin,member,reader Jul 19 15:38:41.784719 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_6a28683ac9174fb4a8e11a5ac75df07c", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6a28683ac9174fb4a8e11a5ac75df07c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6a28683ac9174fb4a8e11a5ac75df07c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/6a28683ac9174fb4a8e11a5ac75df07c"}]}] Jul 19 15:38:41.784719 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: X-Tenant: admin Jul 19 15:38:41.784719 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: X-Tenant-Id: 6a28683ac9174fb4a8e11a5ac75df07c Jul 19 15:38:41.784719 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: X-Tenant-Name: admin Jul 19 15:38:41.784719 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: X-User: admin Jul 19 15:38:41.784719 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: X-User-Domain-Id: default Jul 19 15:38:41.784719 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: X-User-Domain-Name: Default Jul 19 15:38:41.784719 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: X-User-Id: dc78df0f6ac445d5b0a04a3f9969c79f Jul 19 15:38:41.784719 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: X-User-Name: admin Jul 19 15:38:41.784719 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: method: > Jul 19 15:38:41.784719 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: exception: Flavor 451 could not be found. Jul 19 15:38:41.784719 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: action_args: {'id': '451'} Jul 19 15:38:41.784719 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: {{(pid=115002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:38:41.784719 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:38:41.785625 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 19 15:38:41.785625 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 19 15:38:41.785625 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 19 15:38:41.785625 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 19 15:38:41.785625 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 15:38:41.785625 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 15:38:41.785625 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 19 15:38:41.785625 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 19 15:38:41.785625 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 19 15:38:41.785625 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:38:41.785625 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 19 15:38:41.785625 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 19 15:38:41.785625 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 19 15:38:41.785625 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: ERROR nova.api.openstack.wsgi Jul 19 15:38:41.785625 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:38:41.785625 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: ERROR nova.api.openstack.wsgi Jul 19 15:38:41.785625 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:38:41.785625 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:38:41.785625 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:38:41.786881 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:38:41.786881 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:38:41.786881 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:38:41.786881 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:38:41.786881 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 19 15:38:41.786881 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 19 15:38:41.786881 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 19 15:38:41.786881 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: ERROR nova.api.openstack.wsgi Jul 19 15:38:41.786881 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:38:41.786881 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: ERROR nova.api.openstack.wsgi Jul 19 15:38:41.786881 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:38:41.786881 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:38:41.786881 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:38:41.786881 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:38:41.786881 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:38:41.786881 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 19 15:38:41.786881 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: ERROR nova.api.openstack.wsgi Jul 19 15:38:41.786881 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi [None req-4bbf7b9a-c037-4ad6-b95f-e86b0f9147da admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=115002) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:38:41.788183 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: INFO nova.api.openstack.requestlog [None req-4bbf7b9a-c037-4ad6-b95f-e86b0f9147da admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.390549 Jul 19 15:38:41.788183 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: [pid: 115002|app: 0|req: 25/49] 10.222.0.64 () {60 vars in 1193 bytes} [Tue Jul 19 15:38:41 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 392 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 19 15:38:41.794014 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi [None req-56e16df2-5f2f-41c0-996b-7c47e46a9b80 admin admin] Calling method '>' {{(pid=115003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:38:41.808239 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: INFO nova.api.openstack.requestlog [None req-56e16df2-5f2f-41c0-996b-7c47e46a9b80 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017795 Jul 19 15:38:41.808757 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: [pid: 115003|app: 0|req: 25/50] 10.222.0.64 () {60 vars in 1210 bytes} [Tue Jul 19 15:38:41 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:38:41.818773 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi [None req-9091abe1-5802-49e2-a30c-56a14ca16eac admin admin] Calling method '>' {{(pid=115002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:38:41.834035 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: INFO nova.api.openstack.requestlog [None req-9091abe1-5802-49e2-a30c-56a14ca16eac admin admin] 10.222.0.64 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018832 Jul 19 15:38:41.834623 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: [pid: 115002|app: 0|req: 26/51] 10.222.0.64 () {60 vars in 1210 bytes} [Tue Jul 19 15:38:41 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:38:41.843880 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi [None req-df097be3-550a-4fc3-8a12-720a0754b7ef admin admin] Calling method '>' {{(pid=115003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:38:41.849336 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: INFO nova.api.openstack.wsgi [None req-df097be3-550a-4fc3-8a12-720a0754b7ef admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 19 15:38:41.850864 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi [None req-df097be3-550a-4fc3-8a12-720a0754b7ef admin admin] Request method failure captured: Jul 19 15:38:41.850864 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 19 15:38:41.850864 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: Accept: application/json Jul 19 15:38:41.850864 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: Accept-Encoding: gzip, deflate Jul 19 15:38:41.850864 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: Connection: keep-alive Jul 19 15:38:41.850864 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: Content-Length: 0 Jul 19 15:38:41.850864 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: Host: 10.222.0.64 Jul 19 15:38:41.850864 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: Openstack-Api-Version: compute 2.90 Jul 19 15:38:41.850864 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: Openstack-System-Scope: None Jul 19 15:38:41.850864 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: User-Agent: python-novaclient Jul 19 15:38:41.850864 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: X-Auth-Token: gAAAAABi1tAB2TmbgN9cKNtJLZ9_gctiS9nGlD1kLTchZOeK4WCMLuyN_cgPH9HPwGurw5ODwtqmoyBGpqFHkmY635_KB1jf_zgmfk4jacZLeKr6b-qOW6zf0oYzs2e-WOXfkwjjfjp6gZLlyiWrMvLuOOco5BXAnt8TrKu7XK6T6xYsB23cDT0 Jul 19 15:38:41.850864 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: X-Domain-Id: None Jul 19 15:38:41.850864 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: X-Domain-Name: None Jul 19 15:38:41.850864 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: X-Identity-Status: Confirmed Jul 19 15:38:41.850864 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: X-Is-Admin-Project: True Jul 19 15:38:41.850864 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: X-Openstack-Nova-Api-Version: 2.90 Jul 19 15:38:41.850864 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: X-Project-Domain-Id: default Jul 19 15:38:41.850864 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: X-Project-Domain-Name: Default Jul 19 15:38:41.850864 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: X-Project-Id: 6a28683ac9174fb4a8e11a5ac75df07c Jul 19 15:38:41.850864 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: X-Project-Name: admin Jul 19 15:38:41.850864 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: X-Role: admin,member,reader Jul 19 15:38:41.850864 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: X-Roles: admin,member,reader Jul 19 15:38:41.852480 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_6a28683ac9174fb4a8e11a5ac75df07c", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6a28683ac9174fb4a8e11a5ac75df07c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6a28683ac9174fb4a8e11a5ac75df07c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/6a28683ac9174fb4a8e11a5ac75df07c"}]}] Jul 19 15:38:41.852480 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: X-Tenant: admin Jul 19 15:38:41.852480 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: X-Tenant-Id: 6a28683ac9174fb4a8e11a5ac75df07c Jul 19 15:38:41.852480 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: X-Tenant-Name: admin Jul 19 15:38:41.852480 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: X-User: admin Jul 19 15:38:41.852480 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: X-User-Domain-Id: default Jul 19 15:38:41.852480 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: X-User-Domain-Name: Default Jul 19 15:38:41.852480 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: X-User-Id: dc78df0f6ac445d5b0a04a3f9969c79f Jul 19 15:38:41.852480 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: X-User-Name: admin Jul 19 15:38:41.852480 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: method: > Jul 19 15:38:41.852480 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: exception: Flavor 451 could not be found. Jul 19 15:38:41.852480 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: action_args: {'id': '451'} Jul 19 15:38:41.852480 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: {{(pid=115003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:38:41.852480 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:38:41.853586 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 19 15:38:41.853586 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 19 15:38:41.853586 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 19 15:38:41.853586 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 19 15:38:41.853586 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 15:38:41.853586 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 15:38:41.853586 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 19 15:38:41.853586 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 19 15:38:41.853586 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 19 15:38:41.853586 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:38:41.853586 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 19 15:38:41.853586 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 19 15:38:41.853586 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 19 15:38:41.853586 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: ERROR nova.api.openstack.wsgi Jul 19 15:38:41.853586 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:38:41.853586 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: ERROR nova.api.openstack.wsgi Jul 19 15:38:41.853586 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:38:41.853586 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:38:41.853586 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:38:41.854891 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:38:41.854891 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:38:41.854891 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:38:41.854891 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:38:41.854891 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 19 15:38:41.854891 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 19 15:38:41.854891 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 19 15:38:41.854891 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: ERROR nova.api.openstack.wsgi Jul 19 15:38:41.854891 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:38:41.854891 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: ERROR nova.api.openstack.wsgi Jul 19 15:38:41.854891 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:38:41.854891 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:38:41.854891 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:38:41.854891 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:38:41.854891 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:38:41.854891 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 19 15:38:41.854891 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: ERROR nova.api.openstack.wsgi Jul 19 15:38:41.854891 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi [None req-df097be3-550a-4fc3-8a12-720a0754b7ef admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=115003) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:38:41.856112 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: INFO nova.api.openstack.requestlog [None req-df097be3-550a-4fc3-8a12-720a0754b7ef admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011904 Jul 19 15:38:41.856112 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: [pid: 115003|app: 0|req: 26/52] 10.222.0.64 () {60 vars in 1193 bytes} [Tue Jul 19 15:38:41 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 19 15:38:42.943661 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi [None req-9091abe1-5802-49e2-a30c-56a14ca16eac admin admin] Calling method '>' {{(pid=115002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:38:42.944667 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: INFO nova.api.openstack.requestlog [None req-9091abe1-5802-49e2-a30c-56a14ca16eac admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001512 Jul 19 15:38:42.945061 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: [pid: 115002|app: 0|req: 27/53] 10.222.0.64 () {56 vars in 1074 bytes} [Tue Jul 19 15:38:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:38:43.462132 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi [None req-ede60623-dd3f-4607-bc4f-17c949b2f851 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=115003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:38:43.479850 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: INFO nova.api.openstack.requestlog [None req-ede60623-dd3f-4607-bc4f-17c949b2f851 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.399901 Jul 19 15:38:43.480390 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: [pid: 115003|app: 0|req: 27/54] 10.222.0.64 () {64 vars in 1235 bytes} [Tue Jul 19 15:38:43 2022] POST /compute/v2.1/flavors => generated 404 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 19 15:38:44.567595 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi [None req-9091abe1-5802-49e2-a30c-56a14ca16eac admin admin] Calling method '>' {{(pid=115002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:38:44.568586 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: INFO nova.api.openstack.requestlog [None req-9091abe1-5802-49e2-a30c-56a14ca16eac admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001409 Jul 19 15:38:44.569030 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: [pid: 115002|app: 0|req: 28/55] 10.222.0.64 () {56 vars in 1074 bytes} [Tue Jul 19 15:38:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:38:45.099561 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi [None req-ca2d4a4a-e5c3-4874-b78f-496570895bc6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=115003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:38:45.116888 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: INFO nova.api.openstack.requestlog [None req-ca2d4a4a-e5c3-4874-b78f-496570895bc6 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.404040 Jul 19 15:38:45.117358 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: [pid: 115003|app: 0|req: 28/56] 10.222.0.64 () {64 vars in 1235 bytes} [Tue Jul 19 15:38:44 2022] POST /compute/v2.1/flavors => generated 405 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 19 15:38:46.094878 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi [None req-9091abe1-5802-49e2-a30c-56a14ca16eac admin admin] Calling method '>' {{(pid=115002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:38:46.095899 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: INFO nova.api.openstack.requestlog [None req-9091abe1-5802-49e2-a30c-56a14ca16eac admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Jul 19 15:38:46.096294 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: [pid: 115002|app: 0|req: 29/57] 10.222.0.64 () {56 vars in 1074 bytes} [Tue Jul 19 15:38:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:38:46.617384 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi [None req-498271c1-1096-40ce-aa74-1798d8c92f18 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=115003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:38:46.635972 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: INFO nova.api.openstack.requestlog [None req-498271c1-1096-40ce-aa74-1798d8c92f18 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.402422 Jul 19 15:38:46.636505 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: [pid: 115003|app: 0|req: 29/58] 10.222.0.64 () {64 vars in 1235 bytes} [Tue Jul 19 15:38:46 2022] POST /compute/v2.1/flavors => generated 407 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 15:38:47.617370 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi [None req-9091abe1-5802-49e2-a30c-56a14ca16eac admin admin] Calling method '>' {{(pid=115002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:38:47.618383 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: INFO nova.api.openstack.requestlog [None req-9091abe1-5802-49e2-a30c-56a14ca16eac admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001414 Jul 19 15:38:47.618788 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: [pid: 115002|app: 0|req: 30/59] 10.222.0.64 () {56 vars in 1074 bytes} [Tue Jul 19 15:38:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:38:48.145382 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi [None req-e8811055-8c93-48b5-b202-e9b362dd4eb0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=115003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:38:48.164567 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: INFO nova.api.openstack.requestlog [None req-e8811055-8c93-48b5-b202-e9b362dd4eb0 admin admin] 10.222.0.64 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.403455 Jul 19 15:38:48.165104 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: [pid: 115003|app: 0|req: 30/60] 10.222.0.64 () {64 vars in 1235 bytes} [Tue Jul 19 15:38:47 2022] POST /compute/v2.1/flavors => generated 409 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 15:38:49.148888 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi [None req-9091abe1-5802-49e2-a30c-56a14ca16eac admin admin] Calling method '>' {{(pid=115002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:38:49.149916 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: INFO nova.api.openstack.requestlog [None req-9091abe1-5802-49e2-a30c-56a14ca16eac admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Jul 19 15:38:49.150310 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: [pid: 115002|app: 0|req: 31/61] 10.222.0.64 () {56 vars in 1074 bytes} [Tue Jul 19 15:38:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:38:49.670903 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi [None req-2aba337f-823e-4313-a2cb-347862f202e8 admin admin] Calling method '>' {{(pid=115003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:38:49.690705 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: INFO nova.api.openstack.requestlog [None req-2aba337f-823e-4313-a2cb-347862f202e8 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.401967 Jul 19 15:38:49.691239 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: [pid: 115003|app: 0|req: 31/62] 10.222.0.64 () {60 vars in 1202 bytes} [Tue Jul 19 15:38:49 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:39:41.922547 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi [None req-9091abe1-5802-49e2-a30c-56a14ca16eac admin admin] Calling method '>' {{(pid=115002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:39:41.923573 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: INFO nova.api.openstack.requestlog [None req-9091abe1-5802-49e2-a30c-56a14ca16eac admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Jul 19 15:39:41.923969 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: [pid: 115002|app: 0|req: 32/63] 10.222.0.64 () {54 vars in 930 bytes} [Tue Jul 19 15:39:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:39:41.935280 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG dbcounter [-] [115003] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=115003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:39:42.308974 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi [None req-e373aa53-f5b3-438a-b3b3-6783798fc7ca admin admin] Calling method '>' {{(pid=115003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:39:42.327681 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: INFO nova.api.openstack.requestlog [None req-e373aa53-f5b3-438a-b3b3-6783798fc7ca admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.397861 Jul 19 15:39:42.328205 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: [pid: 115003|app: 0|req: 32/64] 10.222.0.64 () {60 vars in 1291 bytes} [Tue Jul 19 15:39:41 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 15:39:42.348873 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG dbcounter [-] [115002] Writing DB stats nova_api:SELECT=19,nova_api:SAVEPOINT=1,nova_api:INSERT=1,nova_api:RELEASE=1 {{(pid=115002) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:39:42.352740 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi [None req-b676d575-09e5-43e6-a9c4-d0aab379eb5d admin admin] Calling method '>' {{(pid=115002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:39:42.361823 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: INFO nova.api.openstack.requestlog [None req-b676d575-09e5-43e6-a9c4-d0aab379eb5d admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014358 Jul 19 15:39:42.362347 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: [pid: 115002|app: 0|req: 33/65] 10.222.0.64 () {60 vars in 1282 bytes} [Tue Jul 19 15:39:42 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:39:42.373890 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi [None req-fc693169-3631-4152-8087-24c3af0fb537 admin admin] Calling method '>' {{(pid=115003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:39:42.381469 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: INFO nova.api.openstack.requestlog [None req-fc693169-3631-4152-8087-24c3af0fb537 admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011112 Jul 19 15:39:42.381978 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: [pid: 115003|app: 0|req: 33/66] 10.222.0.64 () {60 vars in 1285 bytes} [Tue Jul 19 15:39:42 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:39:42.393425 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi [None req-71c95e92-273a-4d92-bbfa-31bd4cfc19bf admin admin] Calling method '>' {{(pid=115002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:39:42.403076 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: INFO nova.api.openstack.requestlog [None req-71c95e92-273a-4d92-bbfa-31bd4cfc19bf admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012710 Jul 19 15:39:42.403476 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: [pid: 115002|app: 0|req: 34/67] 10.222.0.64 () {60 vars in 1285 bytes} [Tue Jul 19 15:39:42 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:39:42.415011 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi [None req-eee2dea5-1027-4193-8336-1480f40b18de admin admin] Calling method '>' {{(pid=115003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:39:42.423198 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: INFO nova.api.openstack.requestlog [None req-eee2dea5-1027-4193-8336-1480f40b18de admin admin] 10.222.0.64 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011734 Jul 19 15:39:42.423721 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: [pid: 115003|app: 0|req: 34/68] 10.222.0.64 () {60 vars in 1282 bytes} [Tue Jul 19 15:39:42 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:43:03.434314 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi [None req-71c95e92-273a-4d92-bbfa-31bd4cfc19bf admin admin] Calling method '>' {{(pid=115002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:43:03.435330 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: INFO nova.api.openstack.requestlog [None req-71c95e92-273a-4d92-bbfa-31bd4cfc19bf admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 Jul 19 15:43:03.435730 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: [pid: 115002|app: 0|req: 35/69] 10.222.0.64 () {56 vars in 1074 bytes} [Tue Jul 19 15:43:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:43:03.576011 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG dbcounter [-] [115003] Writing DB stats nova_api:SELECT=6 {{(pid=115003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:43:03.736752 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi [None req-2189b7f6-b683-402c-89e7-b57555c883e8 admin admin] Calling method '>' {{(pid=115003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:43:03.737928 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 15:43:03.737928 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: warnings.warn(msg) Jul 19 15:43:03.739166 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG oslo_concurrency.lockutils [None req-2189b7f6-b683-402c-89e7-b57555c883e8 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:03.739601 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG oslo_concurrency.lockutils [None req-2189b7f6-b683-402c-89e7-b57555c883e8 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:03.740377 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG oslo_concurrency.lockutils [None req-2189b7f6-b683-402c-89e7-b57555c883e8 admin admin] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:03.740798 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG oslo_concurrency.lockutils [None req-2189b7f6-b683-402c-89e7-b57555c883e8 admin admin] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:03.774207 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: INFO nova.api.openstack.requestlog [None req-2189b7f6-b683-402c-89e7-b57555c883e8 admin admin] 10.222.0.64 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.199719 Jul 19 15:43:03.774780 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: [pid: 115003|app: 0|req: 35/70] 10.222.0.64 () {60 vars in 1193 bytes} [Tue Jul 19 15:43:03 2022] GET /compute/v2.1/os-services => generated 791 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 15:43:04.604131 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi [None req-71c95e92-273a-4d92-bbfa-31bd4cfc19bf admin admin] Calling method '>' {{(pid=115002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:43:04.605190 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: INFO nova.api.openstack.requestlog [None req-71c95e92-273a-4d92-bbfa-31bd4cfc19bf admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Jul 19 15:43:04.605588 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: [pid: 115002|app: 0|req: 36/71] 10.222.0.64 () {56 vars in 1074 bytes} [Tue Jul 19 15:43:04 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:43:04.800417 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi [None req-8a731a57-7746-4e47-82e8-9ae4a2b08104 admin admin] Calling method '>' {{(pid=115003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:43:04.801610 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 15:43:04.801610 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: warnings.warn(msg) Jul 19 15:43:04.802864 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG oslo_concurrency.lockutils [None req-8a731a57-7746-4e47-82e8-9ae4a2b08104 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:04.803329 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG oslo_concurrency.lockutils [None req-8a731a57-7746-4e47-82e8-9ae4a2b08104 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:04.804146 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG oslo_concurrency.lockutils [None req-8a731a57-7746-4e47-82e8-9ae4a2b08104 admin admin] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:04.804572 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG oslo_concurrency.lockutils [None req-8a731a57-7746-4e47-82e8-9ae4a2b08104 admin admin] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:04.825273 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: INFO nova.api.openstack.requestlog [None req-8a731a57-7746-4e47-82e8-9ae4a2b08104 admin admin] 10.222.0.64 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.077493 Jul 19 15:43:04.825775 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: [pid: 115003|app: 0|req: 36/72] 10.222.0.64 () {60 vars in 1193 bytes} [Tue Jul 19 15:43:04 2022] GET /compute/v2.1/os-services => generated 791 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 19 15:43:16.078730 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi [None req-71c95e92-273a-4d92-bbfa-31bd4cfc19bf admin admin] Calling method '>' {{(pid=115002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:43:16.079723 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: INFO nova.api.openstack.requestlog [None req-71c95e92-273a-4d92-bbfa-31bd4cfc19bf admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Jul 19 15:43:16.080122 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: [pid: 115002|app: 0|req: 37/73] 10.222.0.64 () {56 vars in 1074 bytes} [Tue Jul 19 15:43:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:43:16.224286 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG dbcounter [-] [115003] Writing DB stats nova_cell0:SELECT=4 {{(pid=115003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:43:16.225009 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG dbcounter [-] [115003] Writing DB stats nova_cell1:SELECT=4 {{(pid=115003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:43:16.225796 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG dbcounter [-] [115003] Writing DB stats nova_api:SELECT=8 {{(pid=115003) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:43:16.279734 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi [None req-30cdfd83-237c-4934-83a2-e245bb494a5f admin admin] Calling method '>' {{(pid=115003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:43:16.280968 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 15:43:16.280968 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: warnings.warn(msg) Jul 19 15:43:16.282174 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG oslo_concurrency.lockutils [None req-30cdfd83-237c-4934-83a2-e245bb494a5f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:16.283007 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG oslo_concurrency.lockutils [None req-30cdfd83-237c-4934-83a2-e245bb494a5f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:16.283799 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG oslo_concurrency.lockutils [None req-30cdfd83-237c-4934-83a2-e245bb494a5f admin admin] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:16.284224 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG oslo_concurrency.lockutils [None req-30cdfd83-237c-4934-83a2-e245bb494a5f admin admin] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:16.309824 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: INFO nova.api.openstack.requestlog [None req-30cdfd83-237c-4934-83a2-e245bb494a5f admin admin] 10.222.0.64 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.090041 Jul 19 15:43:16.310307 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: [pid: 115003|app: 0|req: 37/74] 10.222.0.64 () {60 vars in 1193 bytes} [Tue Jul 19 15:43:16 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:43:17.137969 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: DEBUG nova.api.openstack.wsgi [None req-71c95e92-273a-4d92-bbfa-31bd4cfc19bf admin admin] Calling method '>' {{(pid=115002) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:43:17.138986 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: INFO nova.api.openstack.requestlog [None req-71c95e92-273a-4d92-bbfa-31bd4cfc19bf admin admin] 10.222.0.64 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Jul 19 15:43:17.139376 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: [pid: 115002|app: 0|req: 38/75] 10.222.0.64 () {56 vars in 1074 bytes} [Tue Jul 19 15:43:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:43:17.329827 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG nova.api.openstack.wsgi [None req-dd08603e-3021-47b9-a656-c51a1a59b84c admin admin] Calling method '>' {{(pid=115003) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:43:17.331090 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 19 15:43:17.331090 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: warnings.warn(msg) Jul 19 15:43:17.332444 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG oslo_concurrency.lockutils [None req-dd08603e-3021-47b9-a656-c51a1a59b84c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:17.333014 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG oslo_concurrency.lockutils [None req-dd08603e-3021-47b9-a656-c51a1a59b84c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=115003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:17.333794 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG oslo_concurrency.lockutils [None req-dd08603e-3021-47b9-a656-c51a1a59b84c admin admin] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=115003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:43:17.334211 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: DEBUG oslo_concurrency.lockutils [None req-dd08603e-3021-47b9-a656-c51a1a59b84c admin admin] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=115003) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:43:17.356696 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: INFO nova.api.openstack.requestlog [None req-dd08603e-3021-47b9-a656-c51a1a59b84c admin admin] 10.222.0.64 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.080169 Jul 19 15:43:17.357147 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: [pid: 115003|app: 0|req: 38/76] 10.222.0.64 () {60 vars in 1193 bytes} [Tue Jul 19 15:43:17 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:44:13.305722 dv-cinder-849022-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 19 15:44:13.306334 dv-cinder-849022-3-iscsi devstack@n-api.service[115001]: Tue Jul 19 15:44:13 2022 - graceful shutdown triggered... Jul 19 15:44:13.306785 dv-cinder-849022-3-iscsi devstack@n-api.service[115002]: Gracefully killing worker 1 (pid: 115002)... Jul 19 15:44:13.307482 dv-cinder-849022-3-iscsi devstack@n-api.service[115003]: Gracefully killing worker 2 (pid: 115003)... Jul 19 15:44:14.306589 dv-cinder-849022-3-iscsi devstack@n-api.service[115001]: worker 1 buried after 1 seconds Jul 19 15:44:14.307140 dv-cinder-849022-3-iscsi devstack@n-api.service[115001]: worker 2 buried after 1 seconds Jul 19 15:44:14.307140 dv-cinder-849022-3-iscsi devstack@n-api.service[115001]: goodbye to uWSGI. Jul 19 15:44:14.308199 dv-cinder-849022-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 19 15:44:14.308737 dv-cinder-849022-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 19 15:44:14.311557 dv-cinder-849022-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 19 15:44:14.320564 dv-cinder-849022-3-iscsi devstack@n-api.service[129504]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 19 15:44:14.322743 dv-cinder-849022-3-iscsi devstack@n-api.service[129504]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 19 15:44:14 2022] *** Jul 19 15:44:14.322743 dv-cinder-849022-3-iscsi devstack@n-api.service[129504]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 19 15:44:14.322743 dv-cinder-849022-3-iscsi devstack@n-api.service[129504]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 19 15:44:14.322743 dv-cinder-849022-3-iscsi devstack@n-api.service[129504]: nodename: dv-cinder-849022-3-iscsi Jul 19 15:44:14.322743 dv-cinder-849022-3-iscsi devstack@n-api.service[129504]: machine: x86_64 Jul 19 15:44:14.322743 dv-cinder-849022-3-iscsi devstack@n-api.service[129504]: clock source: unix Jul 19 15:44:14.322743 dv-cinder-849022-3-iscsi devstack@n-api.service[129504]: pcre jit disabled Jul 19 15:44:14.322743 dv-cinder-849022-3-iscsi devstack@n-api.service[129504]: detected number of CPU cores: 4 Jul 19 15:44:14.322743 dv-cinder-849022-3-iscsi devstack@n-api.service[129504]: current working directory: / Jul 19 15:44:14.322743 dv-cinder-849022-3-iscsi devstack@n-api.service[129504]: detected binary path: /usr/bin/uwsgi-core Jul 19 15:44:14.322743 dv-cinder-849022-3-iscsi devstack@n-api.service[129504]: your processes number limit is 47680 Jul 19 15:44:14.322743 dv-cinder-849022-3-iscsi devstack@n-api.service[129504]: your memory page size is 4096 bytes Jul 19 15:44:14.322743 dv-cinder-849022-3-iscsi devstack@n-api.service[129504]: detected max file descriptor number: 2048 Jul 19 15:44:14.322743 dv-cinder-849022-3-iscsi devstack@n-api.service[129504]: lock engine: pthread robust mutexes Jul 19 15:44:14.323597 dv-cinder-849022-3-iscsi devstack@n-api.service[129504]: thunder lock: enabled Jul 19 15:44:14.323597 dv-cinder-849022-3-iscsi devstack@n-api.service[129504]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 19 15:44:14.323597 dv-cinder-849022-3-iscsi devstack@n-api.service[129504]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 19 15:44:14.368766 dv-cinder-849022-3-iscsi devstack@n-api.service[129504]: Python main interpreter initialized at 0x5576515ed9c0 Jul 19 15:44:14.368766 dv-cinder-849022-3-iscsi devstack@n-api.service[129504]: python threads support enabled Jul 19 15:44:14.368766 dv-cinder-849022-3-iscsi devstack@n-api.service[129504]: your server socket listen backlog is limited to 100 connections Jul 19 15:44:14.368766 dv-cinder-849022-3-iscsi devstack@n-api.service[129504]: your mercy for graceful operations on workers is 90 seconds Jul 19 15:44:14.369220 dv-cinder-849022-3-iscsi devstack@n-api.service[129504]: mapped 403077 bytes (393 KB) for 2 cores Jul 19 15:44:14.369220 dv-cinder-849022-3-iscsi devstack@n-api.service[129504]: *** Operational MODE: preforking *** Jul 19 15:44:14.369491 dv-cinder-849022-3-iscsi devstack@n-api.service[129504]: *** uWSGI is running in multiple interpreter mode *** Jul 19 15:44:14.369491 dv-cinder-849022-3-iscsi devstack@n-api.service[129504]: spawned uWSGI master process (pid: 129504) Jul 19 15:44:14.369698 dv-cinder-849022-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 19 15:44:14.372440 dv-cinder-849022-3-iscsi devstack@n-api.service[129504]: spawned uWSGI worker 1 (pid: 129519, cores: 1) Jul 19 15:44:14.374780 dv-cinder-849022-3-iscsi devstack@n-api.service[129504]: spawned uWSGI worker 2 (pid: 129520, cores: 1) Jul 19 15:44:14.375002 dv-cinder-849022-3-iscsi devstack@n-api.service[129504]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 19 15:44:15.036324 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 19 15:44:15.063989 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 19 15:44:16.240615 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 19 15:44:16.240615 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: from cryptography.utils import int_from_bytes Jul 19 15:44:16.241256 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 19 15:44:16.241256 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: from cryptography.utils import int_from_bytes Jul 19 15:44:16.293973 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 19 15:44:16.293973 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: from cryptography.utils import int_from_bytes Jul 19 15:44:16.294924 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 19 15:44:16.294924 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: from cryptography.utils import int_from_bytes Jul 19 15:44:18.571425 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 19 15:44:18.571976 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 19 15:44:18.572205 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 19 15:44:18.572568 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 19 15:44:18.572830 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 19 15:44:18.573224 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.573549 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.573869 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.574894 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.574894 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.574894 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.575160 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.575449 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.575778 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.576038 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.576355 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.576679 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849022-3-iscsi {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.577002 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.577309 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.577624 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.577945 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.578805 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.579135 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.579445 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.579943 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.581297 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.581297 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.581297 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.581297 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.581682 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.581935 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.582258 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.583048 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.583048 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.583264 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.583638 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849022-3-iscsi {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.583934 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.584267 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.584563 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.584988 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.585318 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.585610 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.587278 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.587278 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.587278 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.587278 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.587278 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.588261 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.588261 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.588261 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.588741 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.588741 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.589060 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.589270 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.589576 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.589830 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.597808 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.597808 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.597808 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.597808 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.597808 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.597808 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.597808 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.598902 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.598902 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.598902 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.598902 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.598902 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.598902 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.598902 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.598902 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.599443 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.599443 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.599443 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.599443 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.599443 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.599443 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.599443 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.64 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.599443 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.64 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.599948 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.599948 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.599948 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.599948 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.599948 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.599948 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.599948 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.599948 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.600487 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.600487 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.600613 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.601088 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.601211 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.601419 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.601725 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.602032 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.602397 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.602668 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.602997 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.603261 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.603616 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.603872 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.604188 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.604477 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.604780 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.605163 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.605446 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.605785 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.606031 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.606343 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.606695 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.607074 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.607283 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.607559 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.607864 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.608178 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.608490 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.608838 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.609145 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.609534 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.610106 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.610106 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.610506 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.610748 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.611064 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.611363 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.611669 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.612047 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.612326 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.612629 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.612948 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.613252 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.613556 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.613861 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.614195 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.615077 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.615077 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.615077 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.615549 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.615693 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.615972 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.616276 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.616593 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.616934 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.617265 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.617612 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.617925 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.618257 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.618640 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.618946 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.619261 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.619577 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.619906 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.620217 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.620531 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.620844 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.621176 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.621477 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.621805 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.622117 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.622456 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.622779 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.623092 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.623412 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.623735 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.624062 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.624371 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.624713 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.625220 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.625551 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.625883 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.626213 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.626572 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.626891 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.627205 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.627533 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.627877 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.628194 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.628516 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.628832 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.629146 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.629459 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.629772 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.630084 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.630456 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.630762 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.631078 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.631390 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.631708 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.632019 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.632334 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.632668 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.632961 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.633272 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.633583 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.633897 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.634206 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.634570 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.634904 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.635214 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.635551 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.635858 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.636172 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.636488 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.636800 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.637109 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.637422 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.637741 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.638046 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.638403 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.638708 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.639017 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.639343 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.639650 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.639962 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.640279 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.641119 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.641438 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.641753 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.642068 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.642424 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.642749 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.643067 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.643405 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.643737 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.644051 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.644380 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.644708 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.645026 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.645330 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.645645 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.645954 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.646258 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.646585 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.646902 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.647209 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.647514 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.647821 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.648208 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.648479 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.648745 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.649057 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.649360 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.649665 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.649972 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.650317 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.650650 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.650995 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.651336 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.651657 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.651982 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.652296 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.652619 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.653015 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.653275 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.653567 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.653859 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.654179 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.654515 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.654840 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.655155 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.655478 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.655790 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.656173 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.657036 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.657366 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.658330 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.658330 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.658330 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.659137 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.659286 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.659548 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.659859 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.660172 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.660484 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.660798 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.661119 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.661717 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.661929 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.662092 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.662438 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.662697 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.663086 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.663328 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.663748 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.663964 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.664297 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.664611 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.664927 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.665253 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.665568 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.665883 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.666198 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.666541 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.666851 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.667165 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.667481 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.667639 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 19 15:44:18.668144 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.668304 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 19 15:44:18.668464 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.668620 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 19 15:44:18.668777 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.668924 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 19 15:44:18.669069 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.669215 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 19 15:44:18.669374 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.669374 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.670084 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.670240 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.670473 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.670628 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.670783 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.674924 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.675160 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.675342 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.677925 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.678103 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.678297 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.678520 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.678691 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.678851 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.679017 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.679165 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.679318 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.679474 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.679647 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.679801 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.679956 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.680101 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.680253 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849022-3-iscsi {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.680409 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.680567 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.680713 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.680859 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.681022 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.681198 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.681352 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.681498 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.681643 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.681796 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.681943 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.682107 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.682263 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.682438 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.682631 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.682781 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.682993 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.683162 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.683308 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.683461 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.683614 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.683760 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.687885 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.688084 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.688243 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.688414 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.688840 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.689004 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.690488 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.690729 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.690886 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.691035 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.691189 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.691189 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.691487 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.691634 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.691779 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.691925 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.692093 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849022-3-iscsi {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.692340 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.692490 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.692636 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.692781 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.692934 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.693095 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.693248 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.693397 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.694496 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.694673 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.694673 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.694984 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.695141 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.695287 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.695434 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.695579 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.695731 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.695892 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.696046 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.696192 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.696338 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.696506 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.696663 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.697506 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.698252 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.698458 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.698641 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.698848 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.699137 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.699318 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.699828 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.700002 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.700159 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.700314 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.700468 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.700622 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.700790 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.700947 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.701101 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.701247 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.701392 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.701544 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.701863 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.702030 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.702177 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.702322 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.702506 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.702657 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.702840 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.703529 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.703727 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.704037 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.704185 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.704455 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.704667 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.704826 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.704826 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.705161 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.705322 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.705490 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.705647 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.705800 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.706003 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.706162 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.706308 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.706493 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.706661 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.706816 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.706963 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.707152 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.707308 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.707462 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.707734 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.707898 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.708044 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.708197 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.708356 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.708503 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.708655 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.708808 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.708959 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.709272 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.709435 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.710034 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.64 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.710297 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.710506 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.64 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.710672 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.710818 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.710977 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.711124 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.711317 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.711468 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.714178 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.714348 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.714619 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.714778 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.714973 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.715171 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.715354 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.716164 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.716356 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.716514 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.716662 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.716815 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.716968 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.717160 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.717353 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.717512 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.717658 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.718051 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.718273 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.718482 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.718683 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.718837 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.718984 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.719137 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.719303 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.719550 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.719730 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.720381 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.720545 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.720693 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.720853 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.721009 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.721166 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.721311 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.721462 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.721607 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.721762 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.721923 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.722069 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.722221 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.723044 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.723212 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.723370 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.723517 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.723670 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.723837 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.723983 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.724128 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.724289 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.724511 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.724661 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.724831 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.724983 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.725144 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.725297 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.725457 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.725609 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.725767 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.725933 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.726096 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.726248 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.726417 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.726624 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.726795 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.726949 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.727101 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.727251 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.727408 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.727568 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.727728 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.727898 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.727898 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.728344 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.728538 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.728704 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.728857 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.729017 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.729176 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.729336 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.729488 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.729821 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.730006 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.730640 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.730829 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.730994 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.731157 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.731318 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.731477 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.731477 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.731773 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.731931 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.732092 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.732260 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.732416 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.732605 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.732762 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.732933 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.733094 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.733428 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.733592 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.733745 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.733902 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.734054 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.734343 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.734526 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.734723 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.734882 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.735034 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.735198 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.735375 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.735536 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.735689 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.735847 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.735998 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.736157 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.736309 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.736469 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.736630 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.736782 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.736941 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.737106 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.737266 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 19 15:44:18.737430 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.737582 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.737732 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.737890 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.738055 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.738217 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.738430 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.738689 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.738840 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.738938 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.739013 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.739084 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.739174 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.739268 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.739354 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.739447 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.739533 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.739625 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.739731 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.739808 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.739888 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.739969 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.740042 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.740120 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.740200 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.740788 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.740883 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.740979 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.741082 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.741171 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.741246 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.741316 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.741401 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.741482 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.741562 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.741635 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.741705 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.741784 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.741869 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.741869 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.742000 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.742078 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.742151 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.742227 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.742320 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.742416 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.742489 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.742571 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.742645 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.742715 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.742795 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.742914 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.742914 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.743058 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.743136 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.743217 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.743289 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.743463 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.743544 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.743623 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.743695 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.743784 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.743857 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.743927 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.744004 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.744075 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.744152 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.744234 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.744314 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.744396 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.744468 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.744546 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.744624 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.744709 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.744782 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.744859 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.744936 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.745014 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.745094 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.745173 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.745252 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.745345 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.745426 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.745499 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.745578 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.745651 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.745721 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.745797 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.745876 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.745948 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.746031 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.746110 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.746189 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.746276 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.746395 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.746489 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.746570 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.746643 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.746712 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.746781 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.746891 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.746985 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.747065 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.747138 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.747208 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.747278 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.747354 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.747434 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.747507 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.747577 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.747653 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.747731 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.747809 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.747930 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.748011 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.748083 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.748159 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.748230 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.748308 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.748381 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.748458 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.748529 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.748598 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.748694 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.749007 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.749102 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.749177 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.749258 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.749331 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.749409 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.749493 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.749566 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.749643 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.749715 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.749785 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.750930 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.751051 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.751137 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.751213 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.751284 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.751284 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.751425 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.751499 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.751577 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.751658 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.751730 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.751801 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.751879 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.751953 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.752031 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.752132 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.752215 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.752289 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.752369 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.752443 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.752513 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.752590 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.752662 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.752732 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.752886 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.752962 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.753040 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.753113 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.753183 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.753266 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.753266 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.753266 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.753266 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.753533 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.753612 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.753696 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.753776 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.753847 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.753924 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.753995 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.754065 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.754147 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.754219 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.754296 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.755027 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.755126 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.755201 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.755201 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.755349 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.755428 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.755509 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.755588 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.755672 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.755753 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.755825 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.755895 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.755964 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.756033 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.756117 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.756190 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.756268 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.756347 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.756418 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.756489 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.756572 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.756652 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.756733 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.756813 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.756936 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.757010 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.757154 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.757244 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.757323 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.757323 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.757466 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.757551 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.757633 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.757717 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.757794 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.757873 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.757945 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.758033 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.758118 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.758192 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.758263 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.758340 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.758445 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.758533 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.758613 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.758685 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.758771 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.758843 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.758920 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.758920 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.759215 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.759754 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.759849 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.759924 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.760010 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.760010 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.760157 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.760230 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.760300 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.760369 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.760448 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.760521 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.760617 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.761175 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.761256 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.761328 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.761409 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.761483 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.761483 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.761609 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.761687 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.761767 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.761852 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.761925 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.761995 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.762065 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.762160 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.762250 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.762330 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.762969 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.763098 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.763181 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.763254 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.763341 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.763417 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.763496 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.763575 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.763648 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.763726 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.763812 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.763893 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.763966 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.764037 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.764115 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.764194 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.764280 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.764361 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.764440 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.764520 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.764593 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.764671 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.764752 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.764832 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.764905 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.765035 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.765110 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.765194 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.765268 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.765345 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.765424 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.765554 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.765632 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.765717 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.765810 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.765885 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.765965 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.766045 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.766124 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.766215 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.766290 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.766385 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.766480 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.766554 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.766625 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.766709 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.766789 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.766861 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.766939 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.767021 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.767258 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.767258 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.767406 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.767480 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.767550 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.767627 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.767720 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.767801 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.767887 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.767960 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.768030 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.768100 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.768179 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.768253 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.768331 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.768410 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.768481 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.768552 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.768634 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.768707 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.768778 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.768856 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.768928 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.769007 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.769007 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.769143 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.769143 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.769279 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.769349 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.769432 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.769505 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.769582 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.769661 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.769734 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.769810 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.769889 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.769981 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.770055 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.770126 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.770203 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.770294 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.770407 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.770483 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.770565 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.770645 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.770724 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.771368 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.771469 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.771551 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.771632 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.771704 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.771788 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.771862 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.771934 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.772005 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.772076 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.772162 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.772253 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.772335 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.772408 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.772485 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.772558 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.772628 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.772711 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.772792 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.772865 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.772936 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.773006 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.773149 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.773246 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.773488 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.773572 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.773803 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.773884 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.774117 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.774200 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.774457 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.774550 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.774932 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.775097 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.775437 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.775604 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.775604 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.775905 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.776064 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.776238 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.776405 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.776566 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.776718 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.776876 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.777028 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.777185 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.777348 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.777501 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.777654 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.777812 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.777964 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.778145 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.778299 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.778535 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.778690 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.778855 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.779016 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.779174 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.779328 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.779478 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.779629 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.779789 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.779940 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.780099 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.780270 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.780424 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.780589 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.780742 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.780912 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.782490 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.782490 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.782820 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.782986 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.783141 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.783293 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.783453 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.783872 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.784045 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.784217 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.784384 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.784539 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.785213 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.785377 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.785531 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.785683 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.785834 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.785986 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.786775 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.786958 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.787121 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.787291 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.787488 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.787646 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.787806 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.787972 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.788125 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.788278 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.788431 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.788582 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.788743 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.788905 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.789058 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.789222 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.789376 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.789528 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.789692 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.789692 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.789985 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.790136 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.790294 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.790493 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.790662 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.790816 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.790976 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.791153 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.791427 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.791593 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.791758 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.791913 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.792083 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.792689 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.792861 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.793026 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.793394 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.793555 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.793723 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.793880 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.794042 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.794222 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.794411 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.794580 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.794741 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.794902 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.795063 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.795226 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.795386 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.795546 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.795699 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.795851 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.796010 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.796173 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.796346 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.796498 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.796650 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.797392 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.797572 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.797733 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.797887 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.798046 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.798208 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.798398 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.798601 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.798760 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.798939 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.799100 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.799261 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.799414 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.799574 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.799734 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.799896 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.800056 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.800217 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.800217 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.801161 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.801342 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.801600 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.801812 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.801979 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.802143 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.802296 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.803012 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.803196 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.803353 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.803545 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.803710 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.803874 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.804042 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.804218 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.804373 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.804527 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.804688 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.804841 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.805007 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.805161 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.805322 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.805490 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.805651 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.805810 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.805973 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.806127 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.806298 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.806489 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.806646 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.806798 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.806959 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.807112 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.807276 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.807467 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.807623 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.807776 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.807938 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.808091 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.808255 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.808408 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.808567 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.808734 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.808895 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.808895 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.809193 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.809346 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.809505 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.809669 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.809823 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.809975 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.810203 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.810422 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.810583 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.810758 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.810924 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.811078 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.811237 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.811389 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.811571 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.811806 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.811975 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.812128 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.812280 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.813484 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.813685 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.813851 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.814007 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.814162 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.814315 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.814315 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.814785 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.814785 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.814929 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.815001 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.815071 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.815149 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.815235 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.815318 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.815391 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.815461 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.815532 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.815611 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.815685 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.815756 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.815826 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.815904 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.815976 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.816065 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.816145 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.816225 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.816303 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.816390 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.816471 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.816558 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.816650 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.816744 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.816830 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.816913 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.817003 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.817102 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.817189 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.817273 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.817363 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.817454 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.817548 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.817633 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.817718 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.817801 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.817891 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.817976 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.818072 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.818166 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.818275 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.818547 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.818654 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.818732 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.818813 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.818886 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.818957 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.819027 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.819114 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.819195 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.819268 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.819345 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.819431 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.819517 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.819651 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.819748 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.819843 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.819935 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.820020 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.820093 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.820178 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.820260 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.820340 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.820412 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.820482 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.820551 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.820621 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.820716 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.820802 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.820886 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.820970 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.821055 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.821151 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.821151 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.821304 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.821388 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.821478 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.821563 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.821655 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.821740 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.821851 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.821925 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.822003 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.822088 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.822180 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.822273 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.822391 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.822480 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.822575 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.822669 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.822763 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.822849 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.822934 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.823025 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.823227 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.823379 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.823654 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.823779 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.823869 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.823961 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.824133 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.824278 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.824452 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.824548 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.824769 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.824872 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.825078 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.825239 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.825392 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.825494 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.825698 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.825799 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.826006 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.826113 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.826332 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.826454 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.826667 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.826770 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.826972 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.827064 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.827301 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.827400 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.827622 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.827724 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.827941 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.828674 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.828978 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.829072 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.829339 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.829495 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.829659 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.829988 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.830080 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.830317 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.830545 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.830690 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.830896 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.830997 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.831218 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.831317 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.831538 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.831643 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.831857 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.831972 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.832177 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.832269 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.832492 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.832597 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.832808 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.832902 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.833132 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.833334 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.833593 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.833946 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.833946 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.834237 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.834482 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.834580 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.834682 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.834770 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.834856 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.834939 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.835115 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.835218 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.835426 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.835527 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.835756 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.835851 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.836089 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.836197 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.836402 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.836505 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.836712 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.836813 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.837027 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.837128 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.837335 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.837438 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.837582 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129519) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 19 15:44:18.837691 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.837959 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.838273 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.838630 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.838955 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.839274 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.839584 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.839951 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.840285 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.840684 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.840924 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.841245 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.841575 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.841903 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.842214 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.842571 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.842890 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.843201 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.843512 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.844681 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.844797 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.845013 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.845351 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.845684 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.846020 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.846339 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.846742 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.847055 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.847377 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.848347 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.848905 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.849225 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.849540 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.849862 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.850176 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.850874 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.850874 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.851219 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.852510 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.852510 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.852510 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.852510 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.852872 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.853108 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.853428 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.853739 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.854053 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.854395 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.854897 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.855175 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.855527 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.855859 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.856186 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.856522 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.856843 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.857177 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.857501 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.857825 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.858148 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.858500 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.858824 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.859153 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.859693 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.860151 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.860481 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.860808 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.861140 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.861736 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.862075 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.862422 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.862766 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.863073 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.863394 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.863714 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.864033 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.864354 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.864675 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.865094 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.865335 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.865668 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.865998 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.866342 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.866698 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.867021 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.867345 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.867667 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.868035 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.868356 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.868672 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.869000 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.869323 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.869643 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.869962 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.870276 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.870626 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.870947 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.871270 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.871586 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.871934 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.872254 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.872593 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.872936 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.873269 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.873591 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.873915 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.874240 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.874856 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.875920 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.876274 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.876612 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.876947 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.877274 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.877602 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.877939 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.878254 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.878615 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.878944 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.879262 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.879573 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.879905 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.880223 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.880536 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.880865 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.881184 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.881781 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.882139 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.882492 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.882831 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.883163 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.883490 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.883805 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.884140 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.884454 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.884766 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.885091 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.885410 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.885721 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.886079 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.886347 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.886697 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.887007 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.887325 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.887636 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.887968 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.888280 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.888592 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.888907 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.889223 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.889534 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.889844 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.890156 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.890493 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.891635 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.891883 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.892210 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.892522 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.892845 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.893155 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.893472 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.893834 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.894171 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.894513 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.894826 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.895151 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.895468 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.895796 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.896201 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.896428 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.896789 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.897114 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.897712 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.898054 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.898443 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.898802 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.899146 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.899461 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.899808 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.900086 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.900418 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.900737 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.901052 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.901371 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.901702 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.902005 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.902327 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.902669 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.902986 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.903302 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.903618 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.903934 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.904250 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.904566 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.904891 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.905252 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.905579 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.905902 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.906407 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.906615 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.906933 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.907250 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.907567 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.907882 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.908204 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.908804 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.909130 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.909442 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.909881 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.910198 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.910554 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.910883 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.911200 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.911528 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.911856 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.912170 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.912555 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.912816 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.913152 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.913500 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.913834 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.914164 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.914502 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.914817 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.915127 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.915444 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.915773 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.916087 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.916402 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.916712 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.917028 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.917337 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.917647 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.917956 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.918265 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.918605 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.918919 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.919229 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.919538 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.919847 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.920156 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.920464 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.920777 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.921084 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.921392 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.921702 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.922099 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.922349 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.922876 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.923223 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.923546 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.923871 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.924190 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.924516 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.924830 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.925155 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.925479 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.925803 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.926120 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.926486 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.926809 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.927125 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.927447 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.927763 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.928079 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.928397 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.928735 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.929070 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.929382 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.929713 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.930039 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.930379 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.930783 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.931103 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.931442 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.931760 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.932078 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.932395 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.932713 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.933031 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.933350 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.933667 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.933982 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.934303 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.934652 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.934983 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.935313 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.935633 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.935968 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.936303 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.936661 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.936978 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.937330 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.938673 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.938796 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.939120 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.939439 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 19 15:44:18.939689 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=129520) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 19 15:44:18.991749 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO dbcounter [None req-ff5c009f-b811-4dee-9939-15209b44b831 None None] Registered counter for database nova_api Jul 19 15:44:19.013696 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_db.sqlalchemy.engines [None req-ff5c009f-b811-4dee-9939-15209b44b831 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129519) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 15:44:19.021697 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG dbcounter [-] [129519] Writer thread running {{(pid=129519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 15:44:19.079867 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.context [None req-ff5c009f-b811-4dee-9939-15209b44b831 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),daf180c5-09be-4981-8daf-984991910d73(cell1) {{(pid=129519) load_cells /opt/stack/nova/nova/context.py:464}} Jul 19 15:44:19.083972 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-ff5c009f-b811-4dee-9939-15209b44b831 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:19.085614 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-ff5c009f-b811-4dee-9939-15209b44b831 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:19.086422 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-ff5c009f-b811-4dee-9939-15209b44b831 None None] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:19.088376 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-ff5c009f-b811-4dee-9939-15209b44b831 None None] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:19.090371 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO dbcounter [None req-ff5c009f-b811-4dee-9939-15209b44b831 None None] Registered counter for database nova_cell0 Jul 19 15:44:19.090697 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO dbcounter [None req-d76f0242-cf2b-4862-b793-5ddeb6fd13d3 None None] Registered counter for database nova_api Jul 19 15:44:19.095010 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO dbcounter [None req-ff5c009f-b811-4dee-9939-15209b44b831 None None] Registered counter for database nova_cell1 Jul 19 15:44:19.102283 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_db.sqlalchemy.engines [None req-ff5c009f-b811-4dee-9939-15209b44b831 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129519) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 15:44:19.104888 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_db.sqlalchemy.engines [None req-ff5c009f-b811-4dee-9939-15209b44b831 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129519) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 15:44:19.110506 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG dbcounter [-] [129519] Writer thread running {{(pid=129519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 15:44:19.111907 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_db.sqlalchemy.engines [None req-d76f0242-cf2b-4862-b793-5ddeb6fd13d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129520) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 15:44:19.113185 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG dbcounter [-] [129519] Writer thread running {{(pid=129519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 15:44:19.118560 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG dbcounter [-] [129520] Writer thread running {{(pid=129520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 15:44:19.175867 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.context [None req-d76f0242-cf2b-4862-b793-5ddeb6fd13d3 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),daf180c5-09be-4981-8daf-984991910d73(cell1) {{(pid=129520) load_cells /opt/stack/nova/nova/context.py:464}} Jul 19 15:44:19.179945 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-d76f0242-cf2b-4862-b793-5ddeb6fd13d3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:19.181548 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-d76f0242-cf2b-4862-b793-5ddeb6fd13d3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:19.182342 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-d76f0242-cf2b-4862-b793-5ddeb6fd13d3 None None] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:44:19.184335 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-d76f0242-cf2b-4862-b793-5ddeb6fd13d3 None None] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:44:19.186324 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO dbcounter [None req-d76f0242-cf2b-4862-b793-5ddeb6fd13d3 None None] Registered counter for database nova_cell0 Jul 19 15:44:19.190464 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO dbcounter [None req-d76f0242-cf2b-4862-b793-5ddeb6fd13d3 None None] Registered counter for database nova_cell1 Jul 19 15:44:19.198098 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_db.sqlalchemy.engines [None req-d76f0242-cf2b-4862-b793-5ddeb6fd13d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129520) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 15:44:19.200278 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_db.sqlalchemy.engines [None req-d76f0242-cf2b-4862-b793-5ddeb6fd13d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129520) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 15:44:19.205386 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG dbcounter [-] [129520] Writer thread running {{(pid=129520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 15:44:19.256050 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO dbcounter [None req-ff5c009f-b811-4dee-9939-15209b44b831 None None] Registered counter for database nova_cell0 Jul 19 15:44:19.263534 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_db.sqlalchemy.engines [None req-ff5c009f-b811-4dee-9939-15209b44b831 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129519) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 15:44:19.268970 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG dbcounter [-] [129519] Writer thread running {{(pid=129519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 15:44:19.343053 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG dbcounter [-] [129520] Writer thread running {{(pid=129520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 15:44:19.355951 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO dbcounter [None req-d76f0242-cf2b-4862-b793-5ddeb6fd13d3 None None] Registered counter for database nova_cell0 Jul 19 15:44:19.363628 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_db.sqlalchemy.engines [None req-d76f0242-cf2b-4862-b793-5ddeb6fd13d3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=129520) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 19 15:44:19.368029 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG dbcounter [-] [129520] Writer thread running {{(pid=129520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 19 15:44:19.593278 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: WARNING keystonemiddleware.auth_token [None req-ff5c009f-b811-4dee-9939-15209b44b831 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 19 15:44:19.600600 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: WARNING keystonemiddleware.auth_token [None req-ff5c009f-b811-4dee-9939-15209b44b831 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 19 15:44:19.700392 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: WARNING keystonemiddleware.auth_token [None req-d76f0242-cf2b-4862-b793-5ddeb6fd13d3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 19 15:44:19.709084 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: WARNING keystonemiddleware.auth_token [None req-d76f0242-cf2b-4862-b793-5ddeb6fd13d3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 19 15:44:19.947989 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: WARNING keystonemiddleware.auth_token [None req-ff5c009f-b811-4dee-9939-15209b44b831 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 19 15:44:19.955232 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: WARNING keystonemiddleware.auth_token [None req-ff5c009f-b811-4dee-9939-15209b44b831 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 19 15:44:19.963021 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5576515ed9c0 pid: 129519 (default app) Jul 19 15:44:20.061822 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: WARNING keystonemiddleware.auth_token [None req-d76f0242-cf2b-4862-b793-5ddeb6fd13d3 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 19 15:44:20.068547 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: WARNING keystonemiddleware.auth_token [None req-d76f0242-cf2b-4862-b793-5ddeb6fd13d3 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 19 15:44:20.074773 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5576515ed9c0 pid: 129520 (default app) Jul 19 15:45:02.294832 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG dbcounter [-] [129519] Writing DB stats nova_api:SELECT=3 {{(pid=129519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:02.297951 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG dbcounter [-] [129519] Writing DB stats nova_cell1:SELECT=3 {{(pid=129519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:02.298873 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG dbcounter [-] [129519] Writing DB stats nova_cell0:SELECT=3 {{(pid=129519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:02.299719 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG dbcounter [-] [129519] Writing DB stats nova_cell0:SELECT=3 {{(pid=129519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:03.639228 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-61a8593b-2312-4470-9aee-5e7cc81dffb7 tempest-VolumesNegativeTest-1692980100 tempest-VolumesNegativeTest-1692980100-project] Action: 'create', calling method: .version_select at 0x7fb8a7b4ec10>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-443522179", "metadata": {"Type": "work"}}} {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:45:03.663747 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-61a8593b-2312-4470-9aee-5e7cc81dffb7 tempest-VolumesNegativeTest-1692980100 tempest-VolumesNegativeTest-1692980100-project] Request method failure captured: Jul 19 15:45:03.663747 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 19 15:45:03.663747 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Accept: application/json Jul 19 15:45:03.663747 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Accept-Encoding: identity Jul 19 15:45:03.663747 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Connection: close Jul 19 15:45:03.663747 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Content-Length: 121 Jul 19 15:45:03.663747 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Content-Type: application/json Jul 19 15:45:03.663747 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Host: 10.222.0.64 Jul 19 15:45:03.663747 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Openstack-System-Scope: None Jul 19 15:45:03.663747 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: User-Agent: python-urllib3/1.26.9 Jul 19 15:45:03.663747 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Auth-Token: gAAAAABi1tF-qPzklFp0W5BYr0ZextIaiw41RiCwPBc75CVUyXbhwKOwXsqaPym-7Yr-1iVedu3WAQ9cEkiHpRbtJzyC75zpvFQmXz7m7xWqfHcf6tpEjR-LJD9C97DM8GFRxBhbg2vGhhI52VEns3TpmF6lU4BYWxB3Tv-vOe-vfemLTsXp_kI Jul 19 15:45:03.663747 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Domain-Id: None Jul 19 15:45:03.663747 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Domain-Name: None Jul 19 15:45:03.663747 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Identity-Status: Confirmed Jul 19 15:45:03.663747 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Is-Admin-Project: True Jul 19 15:45:03.663747 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Domain-Id: default Jul 19 15:45:03.663747 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Domain-Name: Default Jul 19 15:45:03.663747 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Id: 3904cb8d017b47c7afb8a73ee7a4807a Jul 19 15:45:03.663747 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Name: tempest-VolumesNegativeTest-1692980100 Jul 19 15:45:03.663747 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Role: member,reader Jul 19 15:45:03.663747 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Roles: member,reader Jul 19 15:45:03.665493 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_3904cb8d017b47c7afb8a73ee7a4807a", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3904cb8d017b47c7afb8a73ee7a4807a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3904cb8d017b47c7afb8a73ee7a4807a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/3904cb8d017b47c7afb8a73ee7a4807a"}]}] Jul 19 15:45:03.665493 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Tenant: tempest-VolumesNegativeTest-1692980100 Jul 19 15:45:03.665493 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Tenant-Id: 3904cb8d017b47c7afb8a73ee7a4807a Jul 19 15:45:03.665493 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Tenant-Name: tempest-VolumesNegativeTest-1692980100 Jul 19 15:45:03.665493 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User: tempest-VolumesNegativeTest-1692980100-project Jul 19 15:45:03.665493 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Domain-Id: default Jul 19 15:45:03.665493 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Domain-Name: Default Jul 19 15:45:03.665493 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Id: 9800f036e5b14f569b5edfc12ff3d7fd Jul 19 15:45:03.665493 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Name: tempest-VolumesNegativeTest-1692980100-project Jul 19 15:45:03.665493 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Jul 19 15:45:03.665493 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-443522179", "metadata": {"Type": "work"}}} Jul 19 15:45:03.665493 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: method: Jul 19 15:45:03.665493 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 19 15:45:03.666625 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-443522179', 'metadata': {'Type': 'work'}}}} Jul 19 15:45:03.666625 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:45:03.666625 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:45:03.666625 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 15:45:03.666625 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 15:45:03.666625 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 15:45:03.666625 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise error Jul 19 15:45:03.666625 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 19 15:45:03.666625 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:45:03.666625 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 19 15:45:03.666625 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 19 15:45:03.666625 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:45:03.666625 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 19 15:45:03.666625 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi '#$%' Jul 19 15:45:03.666625 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:45:03.666625 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:45:03.666625 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:45:03.666625 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:45:03.666625 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:45:03.666625 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:45:03.666625 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:45:03.666625 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:45:03.668262 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 15:45:03.668262 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 15:45:03.668262 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:45:03.668262 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:45:03.668262 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 15:45:03.668262 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 15:45:03.668262 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 15:45:03.668262 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 15:45:03.668262 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 15:45:03.668262 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 15:45:03.668262 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 19 15:45:03.668262 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:45:03.668262 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:45:03.668262 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:45:03.668262 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:45:03.668262 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:45:03.668262 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:45:03.668262 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 15:45:03.668262 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 15:45:03.669464 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 19 15:45:03.669464 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:45:03.669464 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-61a8593b-2312-4470-9aee-5e7cc81dffb7 tempest-VolumesNegativeTest-1692980100 tempest-VolumesNegativeTest-1692980100-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=129519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:45:03.673484 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-61a8593b-2312-4470-9aee-5e7cc81dffb7 tempest-VolumesNegativeTest-1692980100 tempest-VolumesNegativeTest-1692980100-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.392006 Jul 19 15:45:03.678529 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 1/1] 10.222.0.64 () {60 vars in 1155 bytes} [Tue Jul 19 15:45:02 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 1399 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 15:45:04.337356 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-722f98c9-497f-4efe-8f58-32d9e43ab0d4 tempest-VolumesNegativeTest-1692980100 tempest-VolumesNegativeTest-1692980100-project] Action: 'create', calling method: .version_select at 0x7fb8a7b92550>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-561360146", "metadata": {"Type": "work"}}} {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:45:04.351531 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-722f98c9-497f-4efe-8f58-32d9e43ab0d4 tempest-VolumesNegativeTest-1692980100 tempest-VolumesNegativeTest-1692980100-project] Request method failure captured: Jul 19 15:45:04.351531 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 19 15:45:04.351531 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Accept: application/json Jul 19 15:45:04.351531 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Accept-Encoding: identity Jul 19 15:45:04.351531 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Connection: close Jul 19 15:45:04.351531 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Content-Length: 119 Jul 19 15:45:04.351531 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Content-Type: application/json Jul 19 15:45:04.351531 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Host: 10.222.0.64 Jul 19 15:45:04.351531 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Openstack-System-Scope: None Jul 19 15:45:04.351531 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: User-Agent: python-urllib3/1.26.9 Jul 19 15:45:04.351531 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Auth-Token: gAAAAABi1tF-qPzklFp0W5BYr0ZextIaiw41RiCwPBc75CVUyXbhwKOwXsqaPym-7Yr-1iVedu3WAQ9cEkiHpRbtJzyC75zpvFQmXz7m7xWqfHcf6tpEjR-LJD9C97DM8GFRxBhbg2vGhhI52VEns3TpmF6lU4BYWxB3Tv-vOe-vfemLTsXp_kI Jul 19 15:45:04.351531 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Domain-Id: None Jul 19 15:45:04.351531 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Domain-Name: None Jul 19 15:45:04.351531 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Identity-Status: Confirmed Jul 19 15:45:04.351531 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Is-Admin-Project: True Jul 19 15:45:04.351531 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Project-Domain-Id: default Jul 19 15:45:04.351531 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Project-Domain-Name: Default Jul 19 15:45:04.351531 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Project-Id: 3904cb8d017b47c7afb8a73ee7a4807a Jul 19 15:45:04.351531 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Project-Name: tempest-VolumesNegativeTest-1692980100 Jul 19 15:45:04.351531 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Role: member,reader Jul 19 15:45:04.351531 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Roles: member,reader Jul 19 15:45:04.353203 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_3904cb8d017b47c7afb8a73ee7a4807a", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3904cb8d017b47c7afb8a73ee7a4807a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3904cb8d017b47c7afb8a73ee7a4807a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/3904cb8d017b47c7afb8a73ee7a4807a"}]}] Jul 19 15:45:04.353203 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Tenant: tempest-VolumesNegativeTest-1692980100 Jul 19 15:45:04.353203 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Tenant-Id: 3904cb8d017b47c7afb8a73ee7a4807a Jul 19 15:45:04.353203 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Tenant-Name: tempest-VolumesNegativeTest-1692980100 Jul 19 15:45:04.353203 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User: tempest-VolumesNegativeTest-1692980100-project Jul 19 15:45:04.353203 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User-Domain-Id: default Jul 19 15:45:04.353203 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User-Domain-Name: Default Jul 19 15:45:04.353203 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User-Id: 9800f036e5b14f569b5edfc12ff3d7fd Jul 19 15:45:04.353203 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User-Name: tempest-VolumesNegativeTest-1692980100-project Jul 19 15:45:04.353203 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Jul 19 15:45:04.353203 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-561360146", "metadata": {"Type": "work"}}} Jul 19 15:45:04.353203 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: method: Jul 19 15:45:04.353203 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 19 15:45:04.354093 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-561360146', 'metadata': {'Type': 'work'}}}} Jul 19 15:45:04.354093 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:45:04.354093 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:45:04.354093 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 15:45:04.354093 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 15:45:04.354093 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 15:45:04.354093 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi raise error Jul 19 15:45:04.354093 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 19 15:45:04.354093 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:45:04.354093 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 19 15:45:04.354093 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 19 15:45:04.354093 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:45:04.354093 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 19 15:45:04.354093 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi '0' Jul 19 15:45:04.354093 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:45:04.354093 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:45:04.354093 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:45:04.354093 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:45:04.354093 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:45:04.354093 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:45:04.354093 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:45:04.354093 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:45:04.355894 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 15:45:04.355894 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 15:45:04.355894 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:45:04.355894 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:45:04.355894 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 15:45:04.355894 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 15:45:04.355894 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 15:45:04.355894 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 15:45:04.355894 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 15:45:04.355894 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 15:45:04.355894 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 19 15:45:04.355894 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:45:04.355894 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:45:04.355894 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:45:04.355894 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:45:04.355894 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:45:04.355894 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:45:04.355894 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 15:45:04.355894 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 15:45:04.357352 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 19 15:45:04.357352 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:45:04.357352 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-722f98c9-497f-4efe-8f58-32d9e43ab0d4 tempest-VolumesNegativeTest-1692980100 tempest-VolumesNegativeTest-1692980100-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=129520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:45:04.357352 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-722f98c9-497f-4efe-8f58-32d9e43ab0d4 tempest-VolumesNegativeTest-1692980100 tempest-VolumesNegativeTest-1692980100-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.672063 Jul 19 15:45:04.367843 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 1/2] 10.222.0.64 () {60 vars in 1155 bytes} [Tue Jul 19 15:45:03 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 684 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 15:45:04.375463 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-85e790d6-2172-4174-86a8-269b8875adbb tempest-VolumesNegativeTest-1692980100 tempest-VolumesNegativeTest-1692980100-project] Action: 'create', calling method: .version_select at 0x7fb8a7b68ee0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-277094962", "metadata": {"Type": "work"}}} {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:45:04.378907 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-85e790d6-2172-4174-86a8-269b8875adbb tempest-VolumesNegativeTest-1692980100 tempest-VolumesNegativeTest-1692980100-project] Request method failure captured: Jul 19 15:45:04.378907 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 19 15:45:04.378907 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Accept: application/json Jul 19 15:45:04.378907 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Accept-Encoding: identity Jul 19 15:45:04.378907 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Connection: close Jul 19 15:45:04.378907 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Content-Length: 118 Jul 19 15:45:04.378907 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Content-Type: application/json Jul 19 15:45:04.378907 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Host: 10.222.0.64 Jul 19 15:45:04.378907 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Openstack-System-Scope: None Jul 19 15:45:04.378907 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: User-Agent: python-urllib3/1.26.9 Jul 19 15:45:04.378907 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Auth-Token: gAAAAABi1tF-qPzklFp0W5BYr0ZextIaiw41RiCwPBc75CVUyXbhwKOwXsqaPym-7Yr-1iVedu3WAQ9cEkiHpRbtJzyC75zpvFQmXz7m7xWqfHcf6tpEjR-LJD9C97DM8GFRxBhbg2vGhhI52VEns3TpmF6lU4BYWxB3Tv-vOe-vfemLTsXp_kI Jul 19 15:45:04.378907 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Domain-Id: None Jul 19 15:45:04.378907 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Domain-Name: None Jul 19 15:45:04.378907 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Identity-Status: Confirmed Jul 19 15:45:04.378907 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Is-Admin-Project: True Jul 19 15:45:04.378907 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Domain-Id: default Jul 19 15:45:04.378907 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Domain-Name: Default Jul 19 15:45:04.378907 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Id: 3904cb8d017b47c7afb8a73ee7a4807a Jul 19 15:45:04.378907 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Name: tempest-VolumesNegativeTest-1692980100 Jul 19 15:45:04.378907 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Role: member,reader Jul 19 15:45:04.378907 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Roles: member,reader Jul 19 15:45:04.380303 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_3904cb8d017b47c7afb8a73ee7a4807a", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3904cb8d017b47c7afb8a73ee7a4807a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3904cb8d017b47c7afb8a73ee7a4807a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/3904cb8d017b47c7afb8a73ee7a4807a"}]}] Jul 19 15:45:04.380303 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Tenant: tempest-VolumesNegativeTest-1692980100 Jul 19 15:45:04.380303 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Tenant-Id: 3904cb8d017b47c7afb8a73ee7a4807a Jul 19 15:45:04.380303 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Tenant-Name: tempest-VolumesNegativeTest-1692980100 Jul 19 15:45:04.380303 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User: tempest-VolumesNegativeTest-1692980100-project Jul 19 15:45:04.380303 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Domain-Id: default Jul 19 15:45:04.380303 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Domain-Name: Default Jul 19 15:45:04.380303 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Id: 9800f036e5b14f569b5edfc12ff3d7fd Jul 19 15:45:04.380303 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Name: tempest-VolumesNegativeTest-1692980100-project Jul 19 15:45:04.380303 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Jul 19 15:45:04.380303 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-277094962", "metadata": {"Type": "work"}}} Jul 19 15:45:04.380303 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: method: Jul 19 15:45:04.380303 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 19 15:45:04.381132 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-277094962', 'metadata': {'Type': 'work'}}}} Jul 19 15:45:04.381132 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:45:04.381132 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:45:04.381132 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 19 15:45:04.381132 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 19 15:45:04.381132 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 19 15:45:04.381132 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise error Jul 19 15:45:04.381132 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 19 15:45:04.381132 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:45:04.381132 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 19 15:45:04.381132 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 19 15:45:04.381132 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:45:04.381132 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 19 15:45:04.381132 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi '' Jul 19 15:45:04.381132 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:45:04.381132 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:45:04.381132 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:45:04.381132 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:45:04.381132 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:45:04.381132 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:45:04.381132 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:45:04.381132 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:45:04.382511 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 15:45:04.382511 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 15:45:04.382511 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:45:04.382511 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:45:04.382511 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 19 15:45:04.382511 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 19 15:45:04.382511 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 19 15:45:04.382511 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 19 15:45:04.382511 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 19 15:45:04.382511 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 19 15:45:04.382511 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 19 15:45:04.382511 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:45:04.382511 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:45:04.382511 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:45:04.382511 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:45:04.382511 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:45:04.382511 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:45:04.382511 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 19 15:45:04.382511 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 19 15:45:04.383682 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 19 15:45:04.383682 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:45:04.383682 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-85e790d6-2172-4174-86a8-269b8875adbb tempest-VolumesNegativeTest-1692980100 tempest-VolumesNegativeTest-1692980100-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=129519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:45:04.383682 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-85e790d6-2172-4174-86a8-269b8875adbb tempest-VolumesNegativeTest-1692980100 tempest-VolumesNegativeTest-1692980100-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010291 Jul 19 15:45:04.388750 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 2/3] 10.222.0.64 () {60 vars in 1155 bytes} [Tue Jul 19 15:45:04 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 15:45:04.393096 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG dbcounter [-] [129520] Writing DB stats nova_api:SELECT=3 {{(pid=129520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:04.394046 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG dbcounter [-] [129520] Writing DB stats nova_cell1:SELECT=3 {{(pid=129520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:04.395642 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG dbcounter [-] [129520] Writing DB stats nova_cell0:SELECT=3 {{(pid=129520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:04.397287 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG dbcounter [-] [129520] Writing DB stats nova_cell0:SELECT=3 {{(pid=129520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:04.405104 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-419565b6-c1ea-48a8-b38c-4b413c1723bf tempest-VolumesNegativeTest-1692980100 tempest-VolumesNegativeTest-1692980100-project] Calling method '.version_select at 0x7fb8a83af0d0>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:04.563452 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-b8bf116a-5c79-4d1a-bea8-69ecc809a612 tempest-VolumesTestJSON-553037552 tempest-VolumesTestJSON-553037552-project] Calling method '.version_select at 0x7fb8a7b68160>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:05.605663 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.wsgi [None req-419565b6-c1ea-48a8-b38c-4b413c1723bf tempest-VolumesNegativeTest-1692980100 tempest-VolumesNegativeTest-1692980100-project] HTTP exception thrown: Volume tempest-invalid-1197140127 could not be found. Jul 19 15:45:05.612565 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-419565b6-c1ea-48a8-b38c-4b413c1723bf tempest-VolumesNegativeTest-1692980100 tempest-VolumesNegativeTest-1692980100-project] Request method failure captured: Jul 19 15:45:05.612565 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1197140127 HTTP/1.1 Jul 19 15:45:05.612565 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Accept: application/json Jul 19 15:45:05.612565 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Accept-Encoding: identity Jul 19 15:45:05.612565 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Connection: close Jul 19 15:45:05.612565 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Content-Length: 0 Jul 19 15:45:05.612565 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Content-Type: application/json Jul 19 15:45:05.612565 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Host: 10.222.0.64 Jul 19 15:45:05.612565 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Openstack-System-Scope: None Jul 19 15:45:05.612565 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: User-Agent: python-urllib3/1.26.9 Jul 19 15:45:05.612565 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Auth-Token: gAAAAABi1tF-qPzklFp0W5BYr0ZextIaiw41RiCwPBc75CVUyXbhwKOwXsqaPym-7Yr-1iVedu3WAQ9cEkiHpRbtJzyC75zpvFQmXz7m7xWqfHcf6tpEjR-LJD9C97DM8GFRxBhbg2vGhhI52VEns3TpmF6lU4BYWxB3Tv-vOe-vfemLTsXp_kI Jul 19 15:45:05.612565 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Domain-Id: None Jul 19 15:45:05.612565 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Domain-Name: None Jul 19 15:45:05.612565 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Identity-Status: Confirmed Jul 19 15:45:05.612565 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Is-Admin-Project: True Jul 19 15:45:05.612565 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Project-Domain-Id: default Jul 19 15:45:05.612565 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Project-Domain-Name: Default Jul 19 15:45:05.612565 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Project-Id: 3904cb8d017b47c7afb8a73ee7a4807a Jul 19 15:45:05.612565 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Project-Name: tempest-VolumesNegativeTest-1692980100 Jul 19 15:45:05.612565 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Role: member,reader Jul 19 15:45:05.612565 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Roles: member,reader Jul 19 15:45:05.614278 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_3904cb8d017b47c7afb8a73ee7a4807a", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3904cb8d017b47c7afb8a73ee7a4807a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3904cb8d017b47c7afb8a73ee7a4807a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/3904cb8d017b47c7afb8a73ee7a4807a"}]}] Jul 19 15:45:05.614278 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Tenant: tempest-VolumesNegativeTest-1692980100 Jul 19 15:45:05.614278 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Tenant-Id: 3904cb8d017b47c7afb8a73ee7a4807a Jul 19 15:45:05.614278 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Tenant-Name: tempest-VolumesNegativeTest-1692980100 Jul 19 15:45:05.614278 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User: tempest-VolumesNegativeTest-1692980100-project Jul 19 15:45:05.614278 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User-Domain-Id: default Jul 19 15:45:05.614278 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User-Domain-Name: Default Jul 19 15:45:05.614278 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User-Id: 9800f036e5b14f569b5edfc12ff3d7fd Jul 19 15:45:05.614278 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User-Name: tempest-VolumesNegativeTest-1692980100-project Jul 19 15:45:05.614278 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: method: Jul 19 15:45:05.614278 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: exception: Volume tempest-invalid-1197140127 could not be found. Jul 19 15:45:05.614278 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: action_args: {'id': 'tempest-invalid-1197140127'} Jul 19 15:45:05.614278 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:45:05.615271 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:45:05.615271 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 15:45:05.615271 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 15:45:05.615271 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 19 15:45:05.615271 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 19 15:45:05.615271 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 19 15:45:05.615271 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 19 15:45:05.615271 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 19 15:45:05.615271 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 19 15:45:05.615271 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 19 15:45:05.615271 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 19 15:45:05.615271 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 15:45:05.615271 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 15:45:05.615271 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 15:45:05.615271 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 15:45:05.615271 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1197140127 could not be found. (HTTP 404) (Request-ID: req-89a517c4-3714-48de-aadc-0c38cbefa4c7) Jul 19 15:45:05.615271 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:45:05.615271 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:45:05.615271 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:45:05.616725 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:45:05.616725 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 19 15:45:05.616725 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 19 15:45:05.616725 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 19 15:45:05.616725 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 19 15:45:05.616725 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 19 15:45:05.616725 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 19 15:45:05.616725 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 19 15:45:05.616725 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 19 15:45:05.616725 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 15:45:05.616725 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 15:45:05.616725 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 19 15:45:05.616725 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 19 15:45:05.616725 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 19 15:45:05.616725 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 19 15:45:05.616725 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 19 15:45:05.616725 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 19 15:45:05.616725 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 19 15:45:05.616725 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 19 15:45:05.618007 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 15:45:05.618007 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 15:45:05.618007 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 15:45:05.618007 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 15:45:05.618007 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1197140127 could not be found. Jul 19 15:45:05.618007 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:45:05.618007 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:45:05.618007 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:45:05.618007 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:45:05.618007 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:45:05.618007 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:45:05.618007 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:45:05.618007 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:45:05.618007 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 15:45:05.618007 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 15:45:05.618007 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:45:05.618007 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:45:05.618007 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 19 15:45:05.618007 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 15:45:05.618007 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1197140127 could not be found. Jul 19 15:45:05.619605 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:45:05.619605 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:45:05.619605 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:45:05.619605 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:45:05.619605 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:45:05.619605 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:45:05.619605 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:45:05.619605 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:45:05.619605 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1197140127 could not be found. Jul 19 15:45:05.619605 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:45:05.621826 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-419565b6-c1ea-48a8-b38c-4b413c1723bf tempest-VolumesNegativeTest-1692980100 tempest-VolumesNegativeTest-1692980100-project] Returning 404 to user: Volume tempest-invalid-1197140127 could not be found. {{(pid=129520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:45:05.623214 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-419565b6-c1ea-48a8-b38c-4b413c1723bf tempest-VolumesNegativeTest-1692980100 tempest-VolumesNegativeTest-1692980100-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1197140127" status: 404 len: 99 microversion: 2.1 time: 1.233130 Jul 19 15:45:05.625395 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 2/4] 10.222.0.64 () {58 vars in 1217 bytes} [Tue Jul 19 15:45:04 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1197140127 => generated 99 bytes in 1236 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jul 19 15:45:05.648878 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-238e3d77-5477-4c72-a4ef-fba5b8fc0927 tempest-VolumesNegativeTest-1692980100 tempest-VolumesNegativeTest-1692980100-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.012100 Jul 19 15:45:05.649437 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-b8bf116a-5c79-4d1a-bea8-69ecc809a612 tempest-VolumesTestJSON-553037552 tempest-VolumesTestJSON-553037552-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/331e98dd-fdb5-48c2-a852-7ab50cff32c2" status: 200 len: 350 microversion: 2.1 time: 1.097253 Jul 19 15:45:05.650799 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 3/5] 10.222.0.64 () {58 vars in 1139 bytes} [Tue Jul 19 15:45:05 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 19 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 19 15:45:05.656105 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 3/6] 10.222.0.64 () {58 vars in 1244 bytes} [Tue Jul 19 15:45:04 2022] GET /compute/v2.1/os-volumes/331e98dd-fdb5-48c2-a852-7ab50cff32c2 => generated 350 bytes in 1105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:45:05.665607 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-a581a75d-2b30-4af6-98ae-3fb69f0026ff tempest-VolumesNegativeTest-1692980100 tempest-VolumesNegativeTest-1692980100-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.007201 Jul 19 15:45:05.693178 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-7c802d5f-8576-4e41-bfd0-025a4d3dcb59 tempest-VolumesNegativeTest-1692980100 tempest-VolumesNegativeTest-1692980100-project] Calling method '.version_select at 0x7fb8a79d7550>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:05.699190 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 4/7] 10.222.0.64 () {58 vars in 1136 bytes} [Tue Jul 19 15:45:05 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 41 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 19 15:45:05.749094 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.wsgi [None req-7c802d5f-8576-4e41-bfd0-025a4d3dcb59 tempest-VolumesNegativeTest-1692980100 tempest-VolumesNegativeTest-1692980100-project] HTTP exception thrown: Volume 16365b0a-16d7-4d7c-ae97-8eabf802a220 could not be found. Jul 19 15:45:05.754288 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-7c802d5f-8576-4e41-bfd0-025a4d3dcb59 tempest-VolumesNegativeTest-1692980100 tempest-VolumesNegativeTest-1692980100-project] Request method failure captured: Jul 19 15:45:05.754288 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: request: DELETE /compute/v2.1/os-volumes/16365b0a-16d7-4d7c-ae97-8eabf802a220 HTTP/1.1 Jul 19 15:45:05.754288 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Accept: application/json Jul 19 15:45:05.754288 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Accept-Encoding: identity Jul 19 15:45:05.754288 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Connection: close Jul 19 15:45:05.754288 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Content-Length: 0 Jul 19 15:45:05.754288 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Content-Type: application/json Jul 19 15:45:05.754288 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Host: 10.222.0.64 Jul 19 15:45:05.754288 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Openstack-System-Scope: None Jul 19 15:45:05.754288 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: User-Agent: python-urllib3/1.26.9 Jul 19 15:45:05.754288 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Auth-Token: gAAAAABi1tF-qPzklFp0W5BYr0ZextIaiw41RiCwPBc75CVUyXbhwKOwXsqaPym-7Yr-1iVedu3WAQ9cEkiHpRbtJzyC75zpvFQmXz7m7xWqfHcf6tpEjR-LJD9C97DM8GFRxBhbg2vGhhI52VEns3TpmF6lU4BYWxB3Tv-vOe-vfemLTsXp_kI Jul 19 15:45:05.754288 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Domain-Id: None Jul 19 15:45:05.754288 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Domain-Name: None Jul 19 15:45:05.754288 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Identity-Status: Confirmed Jul 19 15:45:05.754288 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Is-Admin-Project: True Jul 19 15:45:05.754288 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Domain-Id: default Jul 19 15:45:05.754288 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Domain-Name: Default Jul 19 15:45:05.754288 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Id: 3904cb8d017b47c7afb8a73ee7a4807a Jul 19 15:45:05.754288 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Name: tempest-VolumesNegativeTest-1692980100 Jul 19 15:45:05.754288 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Role: member,reader Jul 19 15:45:05.754288 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Roles: member,reader Jul 19 15:45:05.755806 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_3904cb8d017b47c7afb8a73ee7a4807a", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3904cb8d017b47c7afb8a73ee7a4807a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3904cb8d017b47c7afb8a73ee7a4807a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/3904cb8d017b47c7afb8a73ee7a4807a"}]}] Jul 19 15:45:05.755806 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Tenant: tempest-VolumesNegativeTest-1692980100 Jul 19 15:45:05.755806 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Tenant-Id: 3904cb8d017b47c7afb8a73ee7a4807a Jul 19 15:45:05.755806 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Tenant-Name: tempest-VolumesNegativeTest-1692980100 Jul 19 15:45:05.755806 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User: tempest-VolumesNegativeTest-1692980100-project Jul 19 15:45:05.755806 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Domain-Id: default Jul 19 15:45:05.755806 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Domain-Name: Default Jul 19 15:45:05.755806 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Id: 9800f036e5b14f569b5edfc12ff3d7fd Jul 19 15:45:05.755806 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Name: tempest-VolumesNegativeTest-1692980100-project Jul 19 15:45:05.755806 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: method: Jul 19 15:45:05.755806 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: exception: Volume 16365b0a-16d7-4d7c-ae97-8eabf802a220 could not be found. Jul 19 15:45:05.755806 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: action_args: {'id': '16365b0a-16d7-4d7c-ae97-8eabf802a220'} Jul 19 15:45:05.755806 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:45:05.757140 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:45:05.757140 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 15:45:05.757140 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 15:45:05.757140 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 19 15:45:05.757140 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 19 15:45:05.757140 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 19 15:45:05.757140 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 19 15:45:05.757140 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 19 15:45:05.757140 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 19 15:45:05.757140 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 19 15:45:05.757140 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 19 15:45:05.757140 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 15:45:05.757140 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 15:45:05.757140 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 15:45:05.757140 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 15:45:05.757140 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 16365b0a-16d7-4d7c-ae97-8eabf802a220 could not be found. (HTTP 404) (Request-ID: req-5ed0b7c1-c7e7-42f9-950f-9c9ad472b39f) Jul 19 15:45:05.757140 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:45:05.757140 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:45:05.757140 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:45:05.758482 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:45:05.758482 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 19 15:45:05.758482 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 19 15:45:05.758482 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 19 15:45:05.758482 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 19 15:45:05.758482 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 19 15:45:05.758482 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 19 15:45:05.758482 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 19 15:45:05.758482 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 19 15:45:05.758482 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 15:45:05.758482 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 15:45:05.758482 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 19 15:45:05.758482 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 19 15:45:05.758482 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 19 15:45:05.758482 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 19 15:45:05.758482 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 19 15:45:05.758482 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 19 15:45:05.758482 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 19 15:45:05.758482 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 19 15:45:05.760039 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 15:45:05.760039 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 15:45:05.760039 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 15:45:05.760039 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 15:45:05.760039 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 16365b0a-16d7-4d7c-ae97-8eabf802a220 could not be found. Jul 19 15:45:05.760039 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:45:05.760039 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:45:05.760039 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:45:05.760039 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:45:05.760039 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:45:05.760039 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:45:05.760039 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:45:05.760039 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:45:05.760039 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 15:45:05.760039 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 15:45:05.760039 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:45:05.760039 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:45:05.760039 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 19 15:45:05.760039 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 15:45:05.761471 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 16365b0a-16d7-4d7c-ae97-8eabf802a220 could not be found. Jul 19 15:45:05.761471 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:45:05.761471 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:45:05.761471 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:45:05.761471 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:45:05.761471 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:45:05.761471 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:45:05.761471 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:45:05.761471 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:45:05.761471 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 16365b0a-16d7-4d7c-ae97-8eabf802a220 could not be found. Jul 19 15:45:05.761471 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:45:05.761471 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-7c802d5f-8576-4e41-bfd0-025a4d3dcb59 tempest-VolumesNegativeTest-1692980100 tempest-VolumesNegativeTest-1692980100-project] Returning 404 to user: Volume 16365b0a-16d7-4d7c-ae97-8eabf802a220 could not be found. {{(pid=129519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:45:05.763955 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-7c802d5f-8576-4e41-bfd0-025a4d3dcb59 tempest-VolumesNegativeTest-1692980100 tempest-VolumesNegativeTest-1692980100-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/16365b0a-16d7-4d7c-ae97-8eabf802a220" status: 404 len: 109 microversion: 2.1 time: 0.077348 Jul 19 15:45:05.809156 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-b8856ef5-37de-46b1-b290-7d5321483be3 tempest-VolumesNegativeTest-1692980100 tempest-VolumesNegativeTest-1692980100-project] Calling method '.version_select at 0x7fb8a79cd160>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:05.815651 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 4/8] 10.222.0.64 () {58 vars in 1247 bytes} [Tue Jul 19 15:45:05 2022] DELETE /compute/v2.1/os-volumes/16365b0a-16d7-4d7c-ae97-8eabf802a220 => generated 109 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 15:45:05.833712 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.wsgi [None req-b8856ef5-37de-46b1-b290-7d5321483be3 tempest-VolumesNegativeTest-1692980100 tempest-VolumesNegativeTest-1692980100-project] HTTP exception thrown: Volume e65ad865-6e6a-4780-96b3-293080620cab could not be found. Jul 19 15:45:05.836450 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-b8856ef5-37de-46b1-b290-7d5321483be3 tempest-VolumesNegativeTest-1692980100 tempest-VolumesNegativeTest-1692980100-project] Request method failure captured: Jul 19 15:45:05.836450 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: request: GET /compute/v2.1/os-volumes/e65ad865-6e6a-4780-96b3-293080620cab HTTP/1.1 Jul 19 15:45:05.836450 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Accept: application/json Jul 19 15:45:05.836450 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Accept-Encoding: identity Jul 19 15:45:05.836450 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Connection: close Jul 19 15:45:05.836450 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Content-Length: 0 Jul 19 15:45:05.836450 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Content-Type: application/json Jul 19 15:45:05.836450 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Host: 10.222.0.64 Jul 19 15:45:05.836450 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Openstack-System-Scope: None Jul 19 15:45:05.836450 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: User-Agent: python-urllib3/1.26.9 Jul 19 15:45:05.836450 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Auth-Token: gAAAAABi1tF-qPzklFp0W5BYr0ZextIaiw41RiCwPBc75CVUyXbhwKOwXsqaPym-7Yr-1iVedu3WAQ9cEkiHpRbtJzyC75zpvFQmXz7m7xWqfHcf6tpEjR-LJD9C97DM8GFRxBhbg2vGhhI52VEns3TpmF6lU4BYWxB3Tv-vOe-vfemLTsXp_kI Jul 19 15:45:05.836450 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Domain-Id: None Jul 19 15:45:05.836450 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Domain-Name: None Jul 19 15:45:05.836450 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Identity-Status: Confirmed Jul 19 15:45:05.836450 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Is-Admin-Project: True Jul 19 15:45:05.836450 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Project-Domain-Id: default Jul 19 15:45:05.836450 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Project-Domain-Name: Default Jul 19 15:45:05.836450 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Project-Id: 3904cb8d017b47c7afb8a73ee7a4807a Jul 19 15:45:05.836450 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Project-Name: tempest-VolumesNegativeTest-1692980100 Jul 19 15:45:05.836450 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Role: member,reader Jul 19 15:45:05.836450 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Roles: member,reader Jul 19 15:45:05.837532 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_3904cb8d017b47c7afb8a73ee7a4807a", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3904cb8d017b47c7afb8a73ee7a4807a"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/3904cb8d017b47c7afb8a73ee7a4807a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/3904cb8d017b47c7afb8a73ee7a4807a"}]}] Jul 19 15:45:05.837532 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Tenant: tempest-VolumesNegativeTest-1692980100 Jul 19 15:45:05.837532 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Tenant-Id: 3904cb8d017b47c7afb8a73ee7a4807a Jul 19 15:45:05.837532 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Tenant-Name: tempest-VolumesNegativeTest-1692980100 Jul 19 15:45:05.837532 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User: tempest-VolumesNegativeTest-1692980100-project Jul 19 15:45:05.837532 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User-Domain-Id: default Jul 19 15:45:05.837532 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User-Domain-Name: Default Jul 19 15:45:05.837532 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User-Id: 9800f036e5b14f569b5edfc12ff3d7fd Jul 19 15:45:05.837532 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User-Name: tempest-VolumesNegativeTest-1692980100-project Jul 19 15:45:05.837532 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: method: Jul 19 15:45:05.837532 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: exception: Volume e65ad865-6e6a-4780-96b3-293080620cab could not be found. Jul 19 15:45:05.837532 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: action_args: {'id': 'e65ad865-6e6a-4780-96b3-293080620cab'} Jul 19 15:45:05.837532 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:45:05.838337 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:45:05.838337 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 15:45:05.838337 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 15:45:05.838337 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 19 15:45:05.838337 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 19 15:45:05.838337 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 19 15:45:05.838337 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 19 15:45:05.838337 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 19 15:45:05.838337 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 19 15:45:05.838337 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 19 15:45:05.838337 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 19 15:45:05.838337 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 15:45:05.838337 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 15:45:05.838337 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 15:45:05.838337 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 15:45:05.838337 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e65ad865-6e6a-4780-96b3-293080620cab could not be found. (HTTP 404) (Request-ID: req-cfe67d82-7747-40d5-9415-c7c7b469e38b) Jul 19 15:45:05.838337 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:45:05.838337 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:45:05.838337 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:45:05.839356 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:45:05.839356 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 19 15:45:05.839356 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 19 15:45:05.839356 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 19 15:45:05.839356 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 19 15:45:05.839356 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 19 15:45:05.839356 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 19 15:45:05.839356 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 19 15:45:05.839356 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 19 15:45:05.839356 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 15:45:05.839356 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 15:45:05.839356 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 19 15:45:05.839356 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 19 15:45:05.839356 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 19 15:45:05.839356 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 19 15:45:05.839356 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 19 15:45:05.839356 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 19 15:45:05.839356 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 19 15:45:05.839356 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 19 15:45:05.840256 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 15:45:05.840256 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 15:45:05.840256 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 15:45:05.840256 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 15:45:05.840256 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e65ad865-6e6a-4780-96b3-293080620cab could not be found. Jul 19 15:45:05.840256 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:45:05.840256 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:45:05.840256 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:45:05.840256 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:45:05.840256 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:45:05.840256 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:45:05.840256 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:45:05.840256 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:45:05.840256 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 15:45:05.840256 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 15:45:05.840256 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:45:05.840256 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:45:05.840256 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 19 15:45:05.840256 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 15:45:05.841069 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e65ad865-6e6a-4780-96b3-293080620cab could not be found. Jul 19 15:45:05.841069 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:45:05.841069 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:45:05.841069 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:45:05.841069 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:45:05.841069 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:45:05.841069 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:45:05.841069 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:45:05.841069 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:45:05.841069 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e65ad865-6e6a-4780-96b3-293080620cab could not be found. Jul 19 15:45:05.841069 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:45:05.841069 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-b8856ef5-37de-46b1-b290-7d5321483be3 tempest-VolumesNegativeTest-1692980100 tempest-VolumesNegativeTest-1692980100-project] Returning 404 to user: Volume e65ad865-6e6a-4780-96b3-293080620cab could not be found. {{(pid=129520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:45:05.841069 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-b8856ef5-37de-46b1-b290-7d5321483be3 tempest-VolumesNegativeTest-1692980100 tempest-VolumesNegativeTest-1692980100-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/e65ad865-6e6a-4780-96b3-293080620cab" status: 404 len: 109 microversion: 2.1 time: 0.064138 Jul 19 15:45:05.841069 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 5/9] 10.222.0.64 () {58 vars in 1244 bytes} [Tue Jul 19 15:45:05 2022] GET /compute/v2.1/os-volumes/e65ad865-6e6a-4780-96b3-293080620cab => generated 109 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 15:45:08.125793 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-a5ea3b3b-e6aa-4bd6-adac-f9ed21675578 tempest-VolumesTestJSON-553037552 tempest-VolumesTestJSON-553037552-project] Calling method '.version_select at 0x7fb8a7997c10>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:08.245485 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-a5ea3b3b-e6aa-4bd6-adac-f9ed21675578 tempest-VolumesTestJSON-553037552 tempest-VolumesTestJSON-553037552-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/613be44a-f11a-446d-964c-9e6f616db5c6" status: 200 len: 350 microversion: 2.1 time: 0.129363 Jul 19 15:45:08.246223 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 5/10] 10.222.0.64 () {58 vars in 1244 bytes} [Tue Jul 19 15:45:08 2022] GET /compute/v2.1/os-volumes/613be44a-f11a-446d-964c-9e6f616db5c6 => generated 350 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:45:10.164949 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-ccc31f36-df30-492e-906f-a0c6c30f8d2b tempest-VolumesTestJSON-553037552 tempest-VolumesTestJSON-553037552-project] Calling method '.version_select at 0x7fb8a79cdee0>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:10.304080 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-ccc31f36-df30-492e-906f-a0c6c30f8d2b tempest-VolumesTestJSON-553037552 tempest-VolumesTestJSON-553037552-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/da96bb8b-ed4f-4480-a68f-558115ccf8a3" status: 200 len: 351 microversion: 2.1 time: 0.146616 Jul 19 15:45:10.304784 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 6/11] 10.222.0.64 () {58 vars in 1244 bytes} [Tue Jul 19 15:45:10 2022] GET /compute/v2.1/os-volumes/da96bb8b-ed4f-4480-a68f-558115ccf8a3 => generated 351 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:45:10.317832 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-0768851f-e5b9-4446-bec2-8c01855a3f6a tempest-VolumesTestJSON-553037552 tempest-VolumesTestJSON-553037552-project] Calling method '.version_select at 0x7fb8a79b2310>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:10.559926 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-0768851f-e5b9-4446-bec2-8c01855a3f6a tempest-VolumesTestJSON-553037552 tempest-VolumesTestJSON-553037552-project] 10.222.0.64 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.246752 Jul 19 15:45:10.560836 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 6/12] 10.222.0.64 () {58 vars in 1133 bytes} [Tue Jul 19 15:45:10 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:45:10.574352 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-4c778573-0040-4fbc-8c0a-23680c913a2d tempest-VolumesTestJSON-553037552 tempest-VolumesTestJSON-553037552-project] Calling method '.version_select at 0x7fb8a79cdaf0>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:10.765269 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-4c778573-0040-4fbc-8c0a-23680c913a2d tempest-VolumesTestJSON-553037552 tempest-VolumesTestJSON-553037552-project] 10.222.0.64 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.194938 Jul 19 15:45:10.765849 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 7/13] 10.222.0.64 () {58 vars in 1148 bytes} [Tue Jul 19 15:45:10 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:45:10.777422 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-740a728f-0975-493d-ae77-39692033784a tempest-VolumesTestJSON-553037552 tempest-VolumesTestJSON-553037552-project] Calling method '.version_select at 0x7fb8a7997dc0>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:10.907351 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-740a728f-0975-493d-ae77-39692033784a tempest-VolumesTestJSON-553037552 tempest-VolumesTestJSON-553037552-project] 10.222.0.64 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.133567 Jul 19 15:45:10.908116 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 7/14] 10.222.0.64 () {58 vars in 1133 bytes} [Tue Jul 19 15:45:10 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:45:10.922121 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-ecab3f7d-9d2f-4858-8487-b073c441a791 tempest-VolumesTestJSON-553037552 tempest-VolumesTestJSON-553037552-project] Calling method '.version_select at 0x7fb8a7b5d550>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:11.126599 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-ecab3f7d-9d2f-4858-8487-b073c441a791 tempest-VolumesTestJSON-553037552 tempest-VolumesTestJSON-553037552-project] 10.222.0.64 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.210392 Jul 19 15:45:11.127709 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 8/15] 10.222.0.64 () {58 vars in 1166 bytes} [Tue Jul 19 15:45:10 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:45:11.141130 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-04de17b7-f08e-493e-957c-839de447dceb tempest-VolumesTestJSON-553037552 tempest-VolumesTestJSON-553037552-project] Calling method '.version_select at 0x7fb8a79b24c0>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:11.340454 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-04de17b7-f08e-493e-957c-839de447dceb tempest-VolumesTestJSON-553037552 tempest-VolumesTestJSON-553037552-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.204854 Jul 19 15:45:11.341061 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 8/16] 10.222.0.64 () {58 vars in 1169 bytes} [Tue Jul 19 15:45:11 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 15:45:11.353893 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-ee85a1ac-911a-4dfd-a58c-b3ca96ec5a29 tempest-VolumesTestJSON-553037552 tempest-VolumesTestJSON-553037552-project] Calling method '.version_select at 0x7fb8a79a8940>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:11.584954 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-ee85a1ac-911a-4dfd-a58c-b3ca96ec5a29 tempest-VolumesTestJSON-553037552 tempest-VolumesTestJSON-553037552-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.235171 Jul 19 15:45:11.586613 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 9/17] 10.222.0.64 () {58 vars in 1154 bytes} [Tue Jul 19 15:45:11 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:45:11.598000 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-a4c7b7c1-5187-4460-a6bc-811d9cc0970e tempest-VolumesTestJSON-553037552 tempest-VolumesTestJSON-553037552-project] Calling method '.version_select at 0x7fb8a79a8d30>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:11.892227 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-a4c7b7c1-5187-4460-a6bc-811d9cc0970e tempest-VolumesTestJSON-553037552 tempest-VolumesTestJSON-553037552-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.297775 Jul 19 15:45:11.893309 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 10/18] 10.222.0.64 () {58 vars in 1187 bytes} [Tue Jul 19 15:45:11 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:45:11.911018 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-f30af92c-409c-4737-8246-f2f540ea9492 tempest-VolumesTestJSON-553037552 tempest-VolumesTestJSON-553037552-project] Calling method '.version_select at 0x7fb8a7b5d820>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:11.967660 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-8c3a8b82-03f5-4043-8ff5-de23e3fd6bf2 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Action: 'create', calling method: .version_select at 0x7fb8a79bb5e0>, body: {"keypair": {"name": "tempest-keypair-1637844085", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJTggoRKb9PhofKEfuONMA6WWzkcQ3ouMVTEOtvH6Im7TL8A85mapexZYzWuVTikKu06nTbOslVS/OlkKZZux+29vGiIykXMTT8DXzLebvQjXggtCHIsRKaknxa9F+SBLQ=="}} {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:45:12.069062 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.quota [None req-8c3a8b82-03f5-4043-8ff5-de23e3fd6bf2 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Getting quotas for project 171a2f5462994c8d98ffd8cbc2ce5677. Resources: {'key_pairs'} {{(pid=129519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 15:45:12.096613 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.quota [None req-8c3a8b82-03f5-4043-8ff5-de23e3fd6bf2 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Getting quotas for user fca86639f2d344be97cb1529dc17f62a and project 171a2f5462994c8d98ffd8cbc2ce5677. Resources: {'key_pairs'} {{(pid=129519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 15:45:12.181430 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-f30af92c-409c-4737-8246-f2f540ea9492 tempest-VolumesTestJSON-553037552 tempest-VolumesTestJSON-553037552-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.274315 Jul 19 15:45:12.181995 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 11/19] 10.222.0.64 () {58 vars in 1154 bytes} [Tue Jul 19 15:45:11 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:45:12.226696 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-8c3a8b82-03f5-4043-8ff5-de23e3fd6bf2 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.705486 Jul 19 15:45:12.242792 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 9/20] 10.222.0.64 () {62 vars in 1199 bytes} [Tue Jul 19 15:45:11 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 722 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jul 19 15:45:17.817653 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-28bc40f1-53e6-4b7c-9cfe-c8d95b8fdf31 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1924027809", "imageRef": "15012099-fe38-45ac-bd33-d884a5ba65f2", "flavorRef": "452", "networks": [{"uuid": "397d0617-8fd5-42c5-ae76-42ed3e65b60f"}]}} {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:45:18.038893 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.network.neutron [None req-28bc40f1-53e6-4b7c-9cfe-c8d95b8fdf31 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] validate_networks() for [('397d0617-8fd5-42c5-ae76-42ed3e65b60f', None, None, None, None, None)] {{(pid=129520) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 15:45:19.696414 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-9fb9b597-d7b9-4a8a-a8c6-9a7e54685896 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Action: 'create', calling method: .version_select at 0x7fb8a7975ca0>, body: {"keypair": {"name": "tempest-keypair-697233227", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOQnea/zg1lFeM1NvQb0Chmok+LAlwOZWfR0k6t0IvD7MhhPgRQuC25vFtkQOJtdeDAQ6lGLa2IfAg/uax0RAVzrE5g8LZMz0KFMy79FvxJ65/rhFWus/Ln4YjWmG2clRQ=="}} {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:45:19.715159 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.quota [None req-9fb9b597-d7b9-4a8a-a8c6-9a7e54685896 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Getting quotas for project 45a72d232f314a78b0e1c3f04b0ed682. Resources: {'key_pairs'} {{(pid=129519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 15:45:19.724028 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.quota [None req-9fb9b597-d7b9-4a8a-a8c6-9a7e54685896 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Getting quotas for user 2d7c42cf0bc84292bb0b7edb9f2e7fc3 and project 45a72d232f314a78b0e1c3f04b0ed682. Resources: {'key_pairs'} {{(pid=129519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 15:45:19.791895 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-9fb9b597-d7b9-4a8a-a8c6-9a7e54685896 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.423604 Jul 19 15:45:19.792507 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 10/21] 10.222.0.64 () {60 vars in 1158 bytes} [Tue Jul 19 15:45:19 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 15:45:20.234052 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.virt.hardware [None req-28bc40f1-53e6-4b7c-9cfe-c8d95b8fdf31 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Flavor limits 0:0:0 {{(pid=129520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 15:45:20.234666 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.virt.hardware [None req-28bc40f1-53e6-4b7c-9cfe-c8d95b8fdf31 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Image limits 0:0:0 {{(pid=129520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 15:45:20.235247 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.virt.hardware [None req-28bc40f1-53e6-4b7c-9cfe-c8d95b8fdf31 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Flavor pref 0:0:0 {{(pid=129520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 15:45:20.235745 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.virt.hardware [None req-28bc40f1-53e6-4b7c-9cfe-c8d95b8fdf31 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Image pref 0:0:0 {{(pid=129520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 15:45:20.236252 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.virt.hardware [None req-28bc40f1-53e6-4b7c-9cfe-c8d95b8fdf31 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 15:45:20.258403 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-d2730c7e-d16c-4b27-be1e-1cf05dd1ce0a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1381091950", "imageRef": "15012099-fe38-45ac-bd33-d884a5ba65f2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4747c92b-9953-4013-87b5-ea57492dd5d4"}], "security_groups": [{"name": "tempest-securitygroup--81923611"}], "key_name": "tempest-keypair-1637844085", "user_data": "}} {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:45:20.292729 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-28bc40f1-53e6-4b7c-9cfe-c8d95b8fdf31 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:20.297217 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-28bc40f1-53e6-4b7c-9cfe-c8d95b8fdf31 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:20.303061 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-28bc40f1-53e6-4b7c-9cfe-c8d95b8fdf31 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:20.303753 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-28bc40f1-53e6-4b7c-9cfe-c8d95b8fdf31 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:20.385480 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.quota [None req-28bc40f1-53e6-4b7c-9cfe-c8d95b8fdf31 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Getting quotas for project 905aecc2e33f4befb1a47740e8d53611. Resources: {'ram', 'instances', 'cores'} {{(pid=129520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 15:45:20.400625 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.quota [None req-28bc40f1-53e6-4b7c-9cfe-c8d95b8fdf31 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Getting quotas for user 831d1557afd649518d34d4f970f96674 and project 905aecc2e33f4befb1a47740e8d53611. Resources: {'ram', 'instances', 'cores'} {{(pid=129520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 15:45:20.447461 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-28bc40f1-53e6-4b7c-9cfe-c8d95b8fdf31 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Going to run 1 instances... {{(pid=129520) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 15:45:20.454013 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-28bc40f1-53e6-4b7c-9cfe-c8d95b8fdf31 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] [instance: 82a77751-75d6-4aa5-a0d6-cb1af296b4e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='15012099-fe38-45ac-bd33-d884a5ba65f2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 15:45:20.640361 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-28bc40f1-53e6-4b7c-9cfe-c8d95b8fdf31 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.197854 Jul 19 15:45:20.641861 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 12/22] 10.222.0.64 () {60 vars in 1146 bytes} [Tue Jul 19 15:45:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 3202 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 15:45:20.667080 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.network.neutron [None req-d2730c7e-d16c-4b27-be1e-1cf05dd1ce0a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] validate_networks() for [('4747c92b-9953-4013-87b5-ea57492dd5d4', None, None, None, None, None)] {{(pid=129519) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 15:45:21.625646 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-b1f3eaeb-e4ad-42aa-9a08-6902214ee4ed tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1547557204", "imageRef": "15012099-fe38-45ac-bd33-d884a5ba65f2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:45:21.732202 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.network.neutron [None req-b1f3eaeb-e4ad-42aa-9a08-6902214ee4ed tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] validate_networks() for [('8dcc6647-13fc-4b32-9768-cee1a56fe5f7', None, None, None, None, None)] {{(pid=129520) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 15:45:22.557308 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.virt.hardware [None req-b1f3eaeb-e4ad-42aa-9a08-6902214ee4ed tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Flavor limits 0:0:0 {{(pid=129520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 15:45:22.558130 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.virt.hardware [None req-b1f3eaeb-e4ad-42aa-9a08-6902214ee4ed tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Image limits 0:0:0 {{(pid=129520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 15:45:22.558960 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.virt.hardware [None req-b1f3eaeb-e4ad-42aa-9a08-6902214ee4ed tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Flavor pref 0:0:0 {{(pid=129520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 15:45:22.559684 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.virt.hardware [None req-b1f3eaeb-e4ad-42aa-9a08-6902214ee4ed tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Image pref 0:0:0 {{(pid=129520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 15:45:22.560491 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.virt.hardware [None req-b1f3eaeb-e4ad-42aa-9a08-6902214ee4ed tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 15:45:22.581113 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b1f3eaeb-e4ad-42aa-9a08-6902214ee4ed tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:22.581836 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b1f3eaeb-e4ad-42aa-9a08-6902214ee4ed tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:22.582818 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b1f3eaeb-e4ad-42aa-9a08-6902214ee4ed tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:22.586914 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b1f3eaeb-e4ad-42aa-9a08-6902214ee4ed tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:22.638569 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.quota [None req-b1f3eaeb-e4ad-42aa-9a08-6902214ee4ed tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Getting quotas for project a872b4eafae74b82896bd09229152104. Resources: {'ram', 'instances', 'cores'} {{(pid=129520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 15:45:22.646809 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.quota [None req-b1f3eaeb-e4ad-42aa-9a08-6902214ee4ed tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Getting quotas for user 4785719411fd4af892868d99fca7cd71 and project a872b4eafae74b82896bd09229152104. Resources: {'ram', 'instances', 'cores'} {{(pid=129520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 15:45:22.685439 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-b1f3eaeb-e4ad-42aa-9a08-6902214ee4ed tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Going to run 1 instances... {{(pid=129520) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 15:45:22.689777 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-b1f3eaeb-e4ad-42aa-9a08-6902214ee4ed tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 764ab5a7-4ebb-4d76-a34b-5f311883bcbe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='15012099-fe38-45ac-bd33-d884a5ba65f2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 15:45:22.815672 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-b1f3eaeb-e4ad-42aa-9a08-6902214ee4ed tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.169849 Jul 19 15:45:22.819997 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 13/23] 10.222.0.64 () {60 vars in 1146 bytes} [Tue Jul 19 15:45:20 2022] POST /compute/v2.1/servers => generated 383 bytes in 2175 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 15:45:22.831027 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-d34f75ba-04b7-43c7-ba4d-a7484f3d1dd6 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:22.831734 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-d34f75ba-04b7-43c7-ba4d-a7484f3d1dd6 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] [instance: 82a77751-75d6-4aa5-a0d6-cb1af296b4e7] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:23.042151 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-d34f75ba-04b7-43c7-ba4d-a7484f3d1dd6 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831d1557afd649518d34d4f970f96674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905aecc2e33f4befb1a47740e8d53611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:23.080726 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-d34f75ba-04b7-43c7-ba4d-a7484f3d1dd6 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] 10.222.0.64 "GET /compute/v2.1/servers/82a77751-75d6-4aa5-a0d6-cb1af296b4e7" status: 200 len: 1215 microversion: 2.1 time: 0.261253 Jul 19 15:45:23.083803 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 14/24] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:45:22 2022] GET /compute/v2.1/servers/82a77751-75d6-4aa5-a0d6-cb1af296b4e7 => generated 1215 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:45:23.096405 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-dc2a697d-0579-4b69-84e4-fc395bba223a tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:23.097247 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-dc2a697d-0579-4b69-84e4-fc395bba223a tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 764ab5a7-4ebb-4d76-a34b-5f311883bcbe] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:23.239290 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.virt.hardware [None req-d2730c7e-d16c-4b27-be1e-1cf05dd1ce0a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Flavor limits 0:0:0 {{(pid=129519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 15:45:23.240070 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.virt.hardware [None req-d2730c7e-d16c-4b27-be1e-1cf05dd1ce0a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Image limits 0:0:0 {{(pid=129519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 15:45:23.240766 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.virt.hardware [None req-d2730c7e-d16c-4b27-be1e-1cf05dd1ce0a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Flavor pref 0:0:0 {{(pid=129519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 15:45:23.241195 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.virt.hardware [None req-d2730c7e-d16c-4b27-be1e-1cf05dd1ce0a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Image pref 0:0:0 {{(pid=129519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 15:45:23.242258 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.virt.hardware [None req-d2730c7e-d16c-4b27-be1e-1cf05dd1ce0a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 15:45:23.279431 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-d2730c7e-d16c-4b27-be1e-1cf05dd1ce0a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:23.294917 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-d2730c7e-d16c-4b27-be1e-1cf05dd1ce0a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:23.296058 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-d2730c7e-d16c-4b27-be1e-1cf05dd1ce0a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:23.300015 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-d2730c7e-d16c-4b27-be1e-1cf05dd1ce0a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:23.345269 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-dc2a697d-0579-4b69-84e4-fc395bba223a tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:23.353370 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-dc2a697d-0579-4b69-84e4-fc395bba223a tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/764ab5a7-4ebb-4d76-a34b-5f311883bcbe" status: 200 len: 1222 microversion: 2.1 time: 0.268314 Jul 19 15:45:23.363414 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.quota [None req-d2730c7e-d16c-4b27-be1e-1cf05dd1ce0a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Getting quotas for project 171a2f5462994c8d98ffd8cbc2ce5677. Resources: {'ram', 'instances', 'cores'} {{(pid=129519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 15:45:23.367327 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 15/25] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:45:23 2022] GET /compute/v2.1/servers/764ab5a7-4ebb-4d76-a34b-5f311883bcbe => generated 1222 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:45:23.372598 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.quota [None req-d2730c7e-d16c-4b27-be1e-1cf05dd1ce0a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Getting quotas for user fca86639f2d344be97cb1529dc17f62a and project 171a2f5462994c8d98ffd8cbc2ce5677. Resources: {'ram', 'instances', 'cores'} {{(pid=129519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 15:45:23.402686 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-d2730c7e-d16c-4b27-be1e-1cf05dd1ce0a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Going to run 1 instances... {{(pid=129519) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 15:45:23.409861 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-d2730c7e-d16c-4b27-be1e-1cf05dd1ce0a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='15012099-fe38-45ac-bd33-d884a5ba65f2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 15:45:23.608727 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-d2730c7e-d16c-4b27-be1e-1cf05dd1ce0a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 3.364324 Jul 19 15:45:23.609939 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 11/26] 10.222.0.64 () {62 vars in 1187 bytes} [Tue Jul 19 15:45:20 2022] POST /compute/v2.1/servers => generated 400 bytes in 3367 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 19 15:45:23.619857 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-8dd4f1bb-1f92-4c1d-927e-7eeb8edef548 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1501537034", "imageRef": "15012099-fe38-45ac-bd33-d884a5ba65f2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:45:23.621101 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-4ae4ef5e-d5ee-4f42-8288-4b428797b10f tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:23.624040 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-4ae4ef5e-d5ee-4f42-8288-4b428797b10f tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:23.720557 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.network.neutron [None req-8dd4f1bb-1f92-4c1d-927e-7eeb8edef548 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] validate_networks() for [('8dcc6647-13fc-4b32-9768-cee1a56fe5f7', None, None, None, None, None)] {{(pid=129520) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 15:45:23.962691 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-4ae4ef5e-d5ee-4f42-8288-4b428797b10f tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:24.001357 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-4ae4ef5e-d5ee-4f42-8288-4b428797b10f tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:24.003116 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-4ae4ef5e-d5ee-4f42-8288-4b428797b10f tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:24.012526 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-4ae4ef5e-d5ee-4f42-8288-4b428797b10f tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 200 len: 1282 microversion: 2.20 time: 0.396092 Jul 19 15:45:24.017643 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 12/27] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:45:23 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 1282 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:45:24.099971 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-784dbaa6-37f5-4d3c-ac01-336694326315 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:24.100591 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-784dbaa6-37f5-4d3c-ac01-336694326315 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] [instance: 82a77751-75d6-4aa5-a0d6-cb1af296b4e7] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:24.107108 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-784dbaa6-37f5-4d3c-ac01-336694326315 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:24.107591 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-784dbaa6-37f5-4d3c-ac01-336694326315 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:24.108413 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-784dbaa6-37f5-4d3c-ac01-336694326315 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:24.108853 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-784dbaa6-37f5-4d3c-ac01-336694326315 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:24.668150 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-784dbaa6-37f5-4d3c-ac01-336694326315 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831d1557afd649518d34d4f970f96674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905aecc2e33f4befb1a47740e8d53611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:24.711945 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-784dbaa6-37f5-4d3c-ac01-336694326315 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] 10.222.0.64 "GET /compute/v2.1/servers/82a77751-75d6-4aa5-a0d6-cb1af296b4e7" status: 200 len: 1219 microversion: 2.1 time: 0.615082 Jul 19 15:45:24.715363 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 13/28] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:45:24 2022] GET /compute/v2.1/servers/82a77751-75d6-4aa5-a0d6-cb1af296b4e7 => generated 1219 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:45:25.045804 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-50558935-8395-4710-bf57-d65ccb98f502 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:25.047598 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-50558935-8395-4710-bf57-d65ccb98f502 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:25.055485 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-50558935-8395-4710-bf57-d65ccb98f502 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:25.056226 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-50558935-8395-4710-bf57-d65ccb98f502 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:25.057696 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-50558935-8395-4710-bf57-d65ccb98f502 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:25.058648 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-50558935-8395-4710-bf57-d65ccb98f502 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:25.325596 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-50558935-8395-4710-bf57-d65ccb98f502 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:25.335734 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-50558935-8395-4710-bf57-d65ccb98f502 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:25.359625 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-50558935-8395-4710-bf57-d65ccb98f502 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:25.360855 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-50558935-8395-4710-bf57-d65ccb98f502 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 200 len: 1286 microversion: 2.20 time: 0.328279 Jul 19 15:45:25.373545 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 14/29] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:45:25 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 1286 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 15:45:25.459074 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.virt.hardware [None req-8dd4f1bb-1f92-4c1d-927e-7eeb8edef548 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Flavor limits 0:0:0 {{(pid=129520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 15:45:25.461311 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.virt.hardware [None req-8dd4f1bb-1f92-4c1d-927e-7eeb8edef548 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Image limits 0:0:0 {{(pid=129520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 15:45:25.462081 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.virt.hardware [None req-8dd4f1bb-1f92-4c1d-927e-7eeb8edef548 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Flavor pref 0:0:0 {{(pid=129520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 15:45:25.464046 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.virt.hardware [None req-8dd4f1bb-1f92-4c1d-927e-7eeb8edef548 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Image pref 0:0:0 {{(pid=129520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 15:45:25.466267 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.virt.hardware [None req-8dd4f1bb-1f92-4c1d-927e-7eeb8edef548 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 15:45:25.494196 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-8dd4f1bb-1f92-4c1d-927e-7eeb8edef548 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:25.502099 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-8dd4f1bb-1f92-4c1d-927e-7eeb8edef548 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:25.506182 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-8dd4f1bb-1f92-4c1d-927e-7eeb8edef548 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:25.508626 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-8dd4f1bb-1f92-4c1d-927e-7eeb8edef548 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:25.560267 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.quota [None req-8dd4f1bb-1f92-4c1d-927e-7eeb8edef548 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Getting quotas for project a872b4eafae74b82896bd09229152104. Resources: {'ram', 'instances', 'cores'} {{(pid=129520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 15:45:25.572840 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.quota [None req-8dd4f1bb-1f92-4c1d-927e-7eeb8edef548 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Getting quotas for user 4785719411fd4af892868d99fca7cd71 and project a872b4eafae74b82896bd09229152104. Resources: {'ram', 'instances', 'cores'} {{(pid=129520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 15:45:25.634736 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-d2bfb2f7-8ee0-4931-a29c-a17757cea935 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-234276717", "imageRef": "15012099-fe38-45ac-bd33-d884a5ba65f2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fe8b95ad-7997-4bfd-893e-d87b2c843602"}], "security_groups": [{"name": "tempest-securitygroup--1190998553"}], "key_name": "tempest-keypair-697233227", "user_data": "}} {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:45:25.640997 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-8dd4f1bb-1f92-4c1d-927e-7eeb8edef548 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Going to run 1 instances... {{(pid=129520) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 15:45:25.651197 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-8dd4f1bb-1f92-4c1d-927e-7eeb8edef548 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 4fa1efb1-1488-48f4-a6ec-9b4787e01277] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='15012099-fe38-45ac-bd33-d884a5ba65f2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 15:45:25.870818 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-8dd4f1bb-1f92-4c1d-927e-7eeb8edef548 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.255344 Jul 19 15:45:25.871825 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 16/30] 10.222.0.64 () {60 vars in 1146 bytes} [Tue Jul 19 15:45:23 2022] POST /compute/v2.1/servers => generated 383 bytes in 2262 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 19 15:45:25.909968 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-6b42dfd0-debe-4d9f-8b41-81b356042bf6 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:25.909968 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-6b42dfd0-debe-4d9f-8b41-81b356042bf6 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] [instance: 82a77751-75d6-4aa5-a0d6-cb1af296b4e7] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:25.929671 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-6b42dfd0-debe-4d9f-8b41-81b356042bf6 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:25.935060 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-6b42dfd0-debe-4d9f-8b41-81b356042bf6 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:25.936877 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-6b42dfd0-debe-4d9f-8b41-81b356042bf6 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:25.937583 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-6b42dfd0-debe-4d9f-8b41-81b356042bf6 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:26.167545 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.network.neutron [None req-d2bfb2f7-8ee0-4931-a29c-a17757cea935 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] validate_networks() for [('fe8b95ad-7997-4bfd-893e-d87b2c843602', None, None, None, None, None)] {{(pid=129519) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 15:45:26.472594 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-6b42dfd0-debe-4d9f-8b41-81b356042bf6 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831d1557afd649518d34d4f970f96674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905aecc2e33f4befb1a47740e8d53611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:26.493523 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-6b42dfd0-debe-4d9f-8b41-81b356042bf6 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] 10.222.0.64 "GET /compute/v2.1/servers/82a77751-75d6-4aa5-a0d6-cb1af296b4e7" status: 200 len: 1211 microversion: 2.1 time: 0.614004 Jul 19 15:45:26.495022 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 17/31] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:45:25 2022] GET /compute/v2.1/servers/82a77751-75d6-4aa5-a0d6-cb1af296b4e7 => generated 1211 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:45:26.510312 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-6494b9fd-b65c-4c07-a2e8-da69b0ff6d24 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:26.511057 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-6494b9fd-b65c-4c07-a2e8-da69b0ff6d24 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 4fa1efb1-1488-48f4-a6ec-9b4787e01277] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:26.962009 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-6494b9fd-b65c-4c07-a2e8-da69b0ff6d24 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:26.974863 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-6494b9fd-b65c-4c07-a2e8-da69b0ff6d24 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277" status: 200 len: 1222 microversion: 2.1 time: 0.478502 Jul 19 15:45:26.985976 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 18/32] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:45:26 2022] GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277 => generated 1222 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:45:26.992433 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-d20dd31c-d3b1-45d7-993f-ee97ac8fb9d8 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:26.993448 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-d20dd31c-d3b1-45d7-993f-ee97ac8fb9d8 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:27.000562 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-d20dd31c-d3b1-45d7-993f-ee97ac8fb9d8 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:27.001857 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-d20dd31c-d3b1-45d7-993f-ee97ac8fb9d8 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:27.002860 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-d20dd31c-d3b1-45d7-993f-ee97ac8fb9d8 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:27.003436 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-d20dd31c-d3b1-45d7-993f-ee97ac8fb9d8 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:27.086910 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-d20dd31c-d3b1-45d7-993f-ee97ac8fb9d8 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:27.099847 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-d20dd31c-d3b1-45d7-993f-ee97ac8fb9d8 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:27.102102 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-d20dd31c-d3b1-45d7-993f-ee97ac8fb9d8 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:27.104475 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-d20dd31c-d3b1-45d7-993f-ee97ac8fb9d8 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 200 len: 1334 microversion: 2.20 time: 0.116557 Jul 19 15:45:27.117879 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 19/33] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:45:26 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 1334 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:45:27.515691 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-ed4ca521-17e6-480d-ac7e-afc1bf9a4369 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:27.517955 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-ed4ca521-17e6-480d-ac7e-afc1bf9a4369 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] [instance: 82a77751-75d6-4aa5-a0d6-cb1af296b4e7] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:27.538236 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-ed4ca521-17e6-480d-ac7e-afc1bf9a4369 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:27.539912 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-ed4ca521-17e6-480d-ac7e-afc1bf9a4369 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:27.546203 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-ed4ca521-17e6-480d-ac7e-afc1bf9a4369 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:27.551603 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-ed4ca521-17e6-480d-ac7e-afc1bf9a4369 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:27.702837 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-ed4ca521-17e6-480d-ac7e-afc1bf9a4369 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831d1557afd649518d34d4f970f96674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905aecc2e33f4befb1a47740e8d53611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:27.716580 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-ed4ca521-17e6-480d-ac7e-afc1bf9a4369 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] 10.222.0.64 "GET /compute/v2.1/servers/82a77751-75d6-4aa5-a0d6-cb1af296b4e7" status: 200 len: 1275 microversion: 2.1 time: 0.207457 Jul 19 15:45:27.717183 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 20/34] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:45:27 2022] GET /compute/v2.1/servers/82a77751-75d6-4aa5-a0d6-cb1af296b4e7 => generated 1275 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:45:27.851515 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.virt.hardware [None req-d2bfb2f7-8ee0-4931-a29c-a17757cea935 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Flavor limits 0:0:0 {{(pid=129519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 15:45:27.851968 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.virt.hardware [None req-d2bfb2f7-8ee0-4931-a29c-a17757cea935 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Image limits 0:0:0 {{(pid=129519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 15:45:27.852440 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.virt.hardware [None req-d2bfb2f7-8ee0-4931-a29c-a17757cea935 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Flavor pref 0:0:0 {{(pid=129519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 15:45:27.852856 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.virt.hardware [None req-d2bfb2f7-8ee0-4931-a29c-a17757cea935 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Image pref 0:0:0 {{(pid=129519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 15:45:27.853276 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.virt.hardware [None req-d2bfb2f7-8ee0-4931-a29c-a17757cea935 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 15:45:27.886002 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-d2bfb2f7-8ee0-4931-a29c-a17757cea935 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:27.887006 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-d2bfb2f7-8ee0-4931-a29c-a17757cea935 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:27.890791 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-d2bfb2f7-8ee0-4931-a29c-a17757cea935 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:27.891790 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-d2bfb2f7-8ee0-4931-a29c-a17757cea935 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:27.957648 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.quota [None req-d2bfb2f7-8ee0-4931-a29c-a17757cea935 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Getting quotas for project 45a72d232f314a78b0e1c3f04b0ed682. Resources: {'ram', 'instances', 'cores'} {{(pid=129519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 15:45:27.972861 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.quota [None req-d2bfb2f7-8ee0-4931-a29c-a17757cea935 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Getting quotas for user 2d7c42cf0bc84292bb0b7edb9f2e7fc3 and project 45a72d232f314a78b0e1c3f04b0ed682. Resources: {'ram', 'instances', 'cores'} {{(pid=129519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 15:45:27.994634 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-6be17434-b8f5-42c6-890f-dbaf5aeb7971 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:27.995346 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-6be17434-b8f5-42c6-890f-dbaf5aeb7971 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 4fa1efb1-1488-48f4-a6ec-9b4787e01277] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:28.005898 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-6be17434-b8f5-42c6-890f-dbaf5aeb7971 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:28.015011 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-6be17434-b8f5-42c6-890f-dbaf5aeb7971 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:28.016555 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-6be17434-b8f5-42c6-890f-dbaf5aeb7971 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:28.017015 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-6be17434-b8f5-42c6-890f-dbaf5aeb7971 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:28.021712 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-d2bfb2f7-8ee0-4931-a29c-a17757cea935 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Going to run 1 instances... {{(pid=129519) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 15:45:28.026915 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-d2bfb2f7-8ee0-4931-a29c-a17757cea935 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: 5f1579c0-907a-490f-ad8e-0fe2db0baf97] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='15012099-fe38-45ac-bd33-d884a5ba65f2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 15:45:28.132663 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-6be17434-b8f5-42c6-890f-dbaf5aeb7971 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:28.146325 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-6be17434-b8f5-42c6-890f-dbaf5aeb7971 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277" status: 200 len: 1226 microversion: 2.1 time: 0.157165 Jul 19 15:45:28.147401 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-d2bfb2f7-8ee0-4931-a29c-a17757cea935 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.517777 Jul 19 15:45:28.154282 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 15/35] 10.222.0.64 () {60 vars in 1146 bytes} [Tue Jul 19 15:45:25 2022] POST /compute/v2.1/servers => generated 402 bytes in 2525 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 15:45:28.172987 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-09c43c08-c039-46e5-ae77-2a3e37cb6329 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:28.174888 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-09c43c08-c039-46e5-ae77-2a3e37cb6329 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:28.176578 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 21/36] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:45:27 2022] GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277 => generated 1226 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:45:28.188259 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-f49c164f-7c07-4719-9aae-eaab7c59c318 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:28.188883 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-f49c164f-7c07-4719-9aae-eaab7c59c318 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: 5f1579c0-907a-490f-ad8e-0fe2db0baf97] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:28.191775 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-09c43c08-c039-46e5-ae77-2a3e37cb6329 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:28.195203 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-09c43c08-c039-46e5-ae77-2a3e37cb6329 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:28.196973 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-09c43c08-c039-46e5-ae77-2a3e37cb6329 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:28.198605 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-09c43c08-c039-46e5-ae77-2a3e37cb6329 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:28.314746 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-f49c164f-7c07-4719-9aae-eaab7c59c318 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7c42cf0bc84292bb0b7edb9f2e7fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a72d232f314a78b0e1c3f04b0ed682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:28.326081 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-f49c164f-7c07-4719-9aae-eaab7c59c318 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/5f1579c0-907a-490f-ad8e-0fe2db0baf97" status: 200 len: 1240 microversion: 2.1 time: 0.148333 Jul 19 15:45:28.327239 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 22/37] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:45:28 2022] GET /compute/v2.1/servers/5f1579c0-907a-490f-ad8e-0fe2db0baf97 => generated 1240 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:45:28.406214 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-09c43c08-c039-46e5-ae77-2a3e37cb6329 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:28.420025 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-09c43c08-c039-46e5-ae77-2a3e37cb6329 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:28.428449 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-09c43c08-c039-46e5-ae77-2a3e37cb6329 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:28.431841 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-09c43c08-c039-46e5-ae77-2a3e37cb6329 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 200 len: 1352 microversion: 2.20 time: 0.276323 Jul 19 15:45:28.432424 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 16/38] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:45:28 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 1352 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:45:28.734663 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-e08f0e42-7027-4f22-a4ad-964d0294c7a4 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:28.735961 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-e08f0e42-7027-4f22-a4ad-964d0294c7a4 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] [instance: 82a77751-75d6-4aa5-a0d6-cb1af296b4e7] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:28.749180 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-e08f0e42-7027-4f22-a4ad-964d0294c7a4 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:28.749983 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-e08f0e42-7027-4f22-a4ad-964d0294c7a4 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:28.751124 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-e08f0e42-7027-4f22-a4ad-964d0294c7a4 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:28.751803 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-e08f0e42-7027-4f22-a4ad-964d0294c7a4 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:28.996501 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-e08f0e42-7027-4f22-a4ad-964d0294c7a4 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831d1557afd649518d34d4f970f96674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905aecc2e33f4befb1a47740e8d53611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:29.008631 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-e08f0e42-7027-4f22-a4ad-964d0294c7a4 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] 10.222.0.64 "GET /compute/v2.1/servers/82a77751-75d6-4aa5-a0d6-cb1af296b4e7" status: 200 len: 1275 microversion: 2.1 time: 0.276451 Jul 19 15:45:29.011747 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 23/39] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:45:28 2022] GET /compute/v2.1/servers/82a77751-75d6-4aa5-a0d6-cb1af296b4e7 => generated 1275 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:45:29.175894 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-94190f1a-710d-449f-b1af-df8e11cc333d tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:29.176639 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-94190f1a-710d-449f-b1af-df8e11cc333d tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 4fa1efb1-1488-48f4-a6ec-9b4787e01277] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:29.205011 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-94190f1a-710d-449f-b1af-df8e11cc333d tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:29.208446 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-94190f1a-710d-449f-b1af-df8e11cc333d tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:29.210086 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-94190f1a-710d-449f-b1af-df8e11cc333d tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:29.218303 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-94190f1a-710d-449f-b1af-df8e11cc333d tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:29.354741 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-1e2b29d8-b670-4afd-9b54-5567ebf62b98 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:29.355839 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-1e2b29d8-b670-4afd-9b54-5567ebf62b98 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: 5f1579c0-907a-490f-ad8e-0fe2db0baf97] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:29.371126 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-94190f1a-710d-449f-b1af-df8e11cc333d tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:29.377644 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-1e2b29d8-b670-4afd-9b54-5567ebf62b98 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:29.378101 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-1e2b29d8-b670-4afd-9b54-5567ebf62b98 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:29.382521 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-94190f1a-710d-449f-b1af-df8e11cc333d tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277" status: 200 len: 1218 microversion: 2.1 time: 0.217770 Jul 19 15:45:29.386168 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 17/40] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:45:29 2022] GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277 => generated 1218 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:45:29.386998 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-1e2b29d8-b670-4afd-9b54-5567ebf62b98 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:29.387462 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-1e2b29d8-b670-4afd-9b54-5567ebf62b98 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:29.450616 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-dccdfd66-d885-4507-b36f-1f6c7dc632b7 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:29.451230 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-dccdfd66-d885-4507-b36f-1f6c7dc632b7 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:29.461038 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-dccdfd66-d885-4507-b36f-1f6c7dc632b7 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:29.461496 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-dccdfd66-d885-4507-b36f-1f6c7dc632b7 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:29.462281 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-dccdfd66-d885-4507-b36f-1f6c7dc632b7 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:29.462760 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-dccdfd66-d885-4507-b36f-1f6c7dc632b7 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:29.577675 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-1e2b29d8-b670-4afd-9b54-5567ebf62b98 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7c42cf0bc84292bb0b7edb9f2e7fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a72d232f314a78b0e1c3f04b0ed682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:29.592177 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-1e2b29d8-b670-4afd-9b54-5567ebf62b98 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/5f1579c0-907a-490f-ad8e-0fe2db0baf97" status: 200 len: 1244 microversion: 2.1 time: 0.242321 Jul 19 15:45:29.604342 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 24/41] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:45:29 2022] GET /compute/v2.1/servers/5f1579c0-907a-490f-ad8e-0fe2db0baf97 => generated 1244 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:45:29.642438 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-dccdfd66-d885-4507-b36f-1f6c7dc632b7 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:29.654600 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-dccdfd66-d885-4507-b36f-1f6c7dc632b7 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:29.657826 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-dccdfd66-d885-4507-b36f-1f6c7dc632b7 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:29.659967 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-dccdfd66-d885-4507-b36f-1f6c7dc632b7 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 200 len: 1352 microversion: 2.20 time: 0.212712 Jul 19 15:45:29.661309 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 18/42] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:45:29 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 1352 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:45:30.027546 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-1b8af19f-d731-46a1-a749-789b4f465cf1 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:30.028278 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-1b8af19f-d731-46a1-a749-789b4f465cf1 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] [instance: 82a77751-75d6-4aa5-a0d6-cb1af296b4e7] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:30.041501 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-1b8af19f-d731-46a1-a749-789b4f465cf1 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:30.049074 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-1b8af19f-d731-46a1-a749-789b4f465cf1 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:30.054026 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-1b8af19f-d731-46a1-a749-789b4f465cf1 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:30.056453 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-1b8af19f-d731-46a1-a749-789b4f465cf1 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:30.401368 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-d0719e1f-aa1a-42d9-8c1a-60c47e872d68 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:30.402641 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-d0719e1f-aa1a-42d9-8c1a-60c47e872d68 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 4fa1efb1-1488-48f4-a6ec-9b4787e01277] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:30.423735 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-d0719e1f-aa1a-42d9-8c1a-60c47e872d68 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:30.427582 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-d0719e1f-aa1a-42d9-8c1a-60c47e872d68 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:30.431967 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-d0719e1f-aa1a-42d9-8c1a-60c47e872d68 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:30.435313 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-d0719e1f-aa1a-42d9-8c1a-60c47e872d68 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:30.602183 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-1b8af19f-d731-46a1-a749-789b4f465cf1 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831d1557afd649518d34d4f970f96674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905aecc2e33f4befb1a47740e8d53611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:30.618282 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-1b8af19f-d731-46a1-a749-789b4f465cf1 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] 10.222.0.64 "GET /compute/v2.1/servers/82a77751-75d6-4aa5-a0d6-cb1af296b4e7" status: 200 len: 1275 microversion: 2.1 time: 0.593747 Jul 19 15:45:30.621422 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 25/43] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:45:30 2022] GET /compute/v2.1/servers/82a77751-75d6-4aa5-a0d6-cb1af296b4e7 => generated 1275 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:45:30.642491 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-ed51f06f-933a-4390-b39e-f97b9845ca47 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:30.648028 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-ed51f06f-933a-4390-b39e-f97b9845ca47 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: 5f1579c0-907a-490f-ad8e-0fe2db0baf97] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:30.677639 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-ed51f06f-933a-4390-b39e-f97b9845ca47 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:30.679562 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-ed51f06f-933a-4390-b39e-f97b9845ca47 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:30.682690 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-ed51f06f-933a-4390-b39e-f97b9845ca47 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:30.689712 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-ed51f06f-933a-4390-b39e-f97b9845ca47 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:31.017124 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-ed51f06f-933a-4390-b39e-f97b9845ca47 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7c42cf0bc84292bb0b7edb9f2e7fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a72d232f314a78b0e1c3f04b0ed682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:31.026742 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-ed51f06f-933a-4390-b39e-f97b9845ca47 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/5f1579c0-907a-490f-ad8e-0fe2db0baf97" status: 200 len: 1236 microversion: 2.1 time: 0.402714 Jul 19 15:45:31.029305 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 26/44] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:45:30 2022] GET /compute/v2.1/servers/5f1579c0-907a-490f-ad8e-0fe2db0baf97 => generated 1236 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:45:31.044265 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-0e32900a-ef79-4c5e-9569-fc5d31de4fd4 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:31.045995 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-0e32900a-ef79-4c5e-9569-fc5d31de4fd4 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:31.061628 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-0e32900a-ef79-4c5e-9569-fc5d31de4fd4 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:31.064546 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-0e32900a-ef79-4c5e-9569-fc5d31de4fd4 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:31.068177 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-0e32900a-ef79-4c5e-9569-fc5d31de4fd4 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:31.068908 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-0e32900a-ef79-4c5e-9569-fc5d31de4fd4 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:31.094400 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-d0719e1f-aa1a-42d9-8c1a-60c47e872d68 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:31.102688 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-d0719e1f-aa1a-42d9-8c1a-60c47e872d68 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277" status: 200 len: 1218 microversion: 2.1 time: 0.706873 Jul 19 15:45:31.113590 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 19/45] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:45:30 2022] GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277 => generated 1218 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:45:31.268539 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-0e32900a-ef79-4c5e-9569-fc5d31de4fd4 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:31.277751 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-0e32900a-ef79-4c5e-9569-fc5d31de4fd4 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:31.279298 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-0e32900a-ef79-4c5e-9569-fc5d31de4fd4 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:31.282662 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-0e32900a-ef79-4c5e-9569-fc5d31de4fd4 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 200 len: 1340 microversion: 2.20 time: 0.250803 Jul 19 15:45:31.283227 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 27/46] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:45:31 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 1340 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:45:31.638619 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-db0f38a9-091c-4b24-a66f-8f6532b28da0 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:31.639953 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-db0f38a9-091c-4b24-a66f-8f6532b28da0 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] [instance: 82a77751-75d6-4aa5-a0d6-cb1af296b4e7] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:31.656950 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-db0f38a9-091c-4b24-a66f-8f6532b28da0 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:31.663126 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-db0f38a9-091c-4b24-a66f-8f6532b28da0 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:31.665886 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-db0f38a9-091c-4b24-a66f-8f6532b28da0 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:31.667616 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-db0f38a9-091c-4b24-a66f-8f6532b28da0 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:32.047594 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-79f1db0d-be67-40ac-95a7-f9b4b6264405 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:32.052930 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-79f1db0d-be67-40ac-95a7-f9b4b6264405 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: 5f1579c0-907a-490f-ad8e-0fe2db0baf97] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:32.083051 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-79f1db0d-be67-40ac-95a7-f9b4b6264405 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:32.083796 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-79f1db0d-be67-40ac-95a7-f9b4b6264405 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:32.087748 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-79f1db0d-be67-40ac-95a7-f9b4b6264405 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:32.093135 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-79f1db0d-be67-40ac-95a7-f9b4b6264405 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:32.324196 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-db0f38a9-091c-4b24-a66f-8f6532b28da0 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831d1557afd649518d34d4f970f96674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905aecc2e33f4befb1a47740e8d53611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:32.349287 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-db0f38a9-091c-4b24-a66f-8f6532b28da0 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] 10.222.0.64 "GET /compute/v2.1/servers/82a77751-75d6-4aa5-a0d6-cb1af296b4e7" status: 200 len: 1273 microversion: 2.1 time: 0.715214 Jul 19 15:45:32.352537 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 20/47] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:45:31 2022] GET /compute/v2.1/servers/82a77751-75d6-4aa5-a0d6-cb1af296b4e7 => generated 1273 bytes in 720 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:45:32.384435 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-13efe0a9-22ef-42b5-ae13-15c9d7743c7f tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:32.387536 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-13efe0a9-22ef-42b5-ae13-15c9d7743c7f tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 4fa1efb1-1488-48f4-a6ec-9b4787e01277] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:32.412307 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-79f1db0d-be67-40ac-95a7-f9b4b6264405 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7c42cf0bc84292bb0b7edb9f2e7fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a72d232f314a78b0e1c3f04b0ed682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:32.427209 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-79f1db0d-be67-40ac-95a7-f9b4b6264405 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/5f1579c0-907a-490f-ad8e-0fe2db0baf97" status: 200 len: 1298 microversion: 2.1 time: 0.379398 Jul 19 15:45:32.428916 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 28/48] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:45:32 2022] GET /compute/v2.1/servers/5f1579c0-907a-490f-ad8e-0fe2db0baf97 => generated 1298 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:45:32.432289 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG dbcounter [-] [129519] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=8 {{(pid=129519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:32.433994 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-13efe0a9-22ef-42b5-ae13-15c9d7743c7f tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:32.434470 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-13efe0a9-22ef-42b5-ae13-15c9d7743c7f tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:32.435247 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-13efe0a9-22ef-42b5-ae13-15c9d7743c7f tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:32.435683 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-13efe0a9-22ef-42b5-ae13-15c9d7743c7f tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:32.441870 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-8e96c168-7445-4f4a-bad3-7982e0a33a60 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:32.449087 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-8e96c168-7445-4f4a-bad3-7982e0a33a60 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:32.466911 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-8e96c168-7445-4f4a-bad3-7982e0a33a60 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:32.475274 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-8e96c168-7445-4f4a-bad3-7982e0a33a60 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:32.479015 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-8e96c168-7445-4f4a-bad3-7982e0a33a60 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:32.479799 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-8e96c168-7445-4f4a-bad3-7982e0a33a60 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:32.798162 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-8e96c168-7445-4f4a-bad3-7982e0a33a60 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:32.818102 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-8e96c168-7445-4f4a-bad3-7982e0a33a60 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:32.823186 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-8e96c168-7445-4f4a-bad3-7982e0a33a60 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:32.825179 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-8e96c168-7445-4f4a-bad3-7982e0a33a60 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 200 len: 1340 microversion: 2.20 time: 0.392859 Jul 19 15:45:32.826500 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 29/49] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:45:32 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 1340 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:45:33.029225 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-13efe0a9-22ef-42b5-ae13-15c9d7743c7f tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:33.046373 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-13efe0a9-22ef-42b5-ae13-15c9d7743c7f tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277" status: 200 len: 1280 microversion: 2.1 time: 0.691269 Jul 19 15:45:33.054135 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 21/50] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:45:32 2022] GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277 => generated 1280 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:45:33.369608 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-0b7973d0-c4d8-4387-9646-14c79086c7bb tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:33.370320 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-0b7973d0-c4d8-4387-9646-14c79086c7bb tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] [instance: 82a77751-75d6-4aa5-a0d6-cb1af296b4e7] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:33.400027 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-0b7973d0-c4d8-4387-9646-14c79086c7bb tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:33.400496 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-0b7973d0-c4d8-4387-9646-14c79086c7bb tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:33.401282 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-0b7973d0-c4d8-4387-9646-14c79086c7bb tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:33.401715 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-0b7973d0-c4d8-4387-9646-14c79086c7bb tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:33.448312 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-6f727a12-4365-4a6d-8c35-3ccaf3f9eb76 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:33.449118 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-6f727a12-4365-4a6d-8c35-3ccaf3f9eb76 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: 5f1579c0-907a-490f-ad8e-0fe2db0baf97] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:33.463371 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-6f727a12-4365-4a6d-8c35-3ccaf3f9eb76 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:33.464004 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-6f727a12-4365-4a6d-8c35-3ccaf3f9eb76 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:33.464940 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-6f727a12-4365-4a6d-8c35-3ccaf3f9eb76 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:33.465869 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-6f727a12-4365-4a6d-8c35-3ccaf3f9eb76 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:33.717280 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-6f727a12-4365-4a6d-8c35-3ccaf3f9eb76 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7c42cf0bc84292bb0b7edb9f2e7fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a72d232f314a78b0e1c3f04b0ed682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:33.730592 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-6f727a12-4365-4a6d-8c35-3ccaf3f9eb76 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/5f1579c0-907a-490f-ad8e-0fe2db0baf97" status: 200 len: 1298 microversion: 2.1 time: 0.288084 Jul 19 15:45:33.731574 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 22/51] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:45:33 2022] GET /compute/v2.1/servers/5f1579c0-907a-490f-ad8e-0fe2db0baf97 => generated 1298 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:45:33.847310 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-da7aff5c-3d4e-4e9a-b251-a17e4b4c0736 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:33.847890 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-da7aff5c-3d4e-4e9a-b251-a17e4b4c0736 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:33.860447 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-da7aff5c-3d4e-4e9a-b251-a17e4b4c0736 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:33.860958 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-da7aff5c-3d4e-4e9a-b251-a17e4b4c0736 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:33.861782 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-da7aff5c-3d4e-4e9a-b251-a17e4b4c0736 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:33.864594 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-da7aff5c-3d4e-4e9a-b251-a17e4b4c0736 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:34.041581 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-0b7973d0-c4d8-4387-9646-14c79086c7bb tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831d1557afd649518d34d4f970f96674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905aecc2e33f4befb1a47740e8d53611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:34.057098 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-0b7973d0-c4d8-4387-9646-14c79086c7bb tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] 10.222.0.64 "GET /compute/v2.1/servers/82a77751-75d6-4aa5-a0d6-cb1af296b4e7" status: 200 len: 1273 microversion: 2.1 time: 0.689122 Jul 19 15:45:34.070654 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 30/52] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:45:33 2022] GET /compute/v2.1/servers/82a77751-75d6-4aa5-a0d6-cb1af296b4e7 => generated 1273 bytes in 706 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:45:34.091336 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-1bd9e428-f60f-4d74-914b-326696acbed4 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:34.092099 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-1bd9e428-f60f-4d74-914b-326696acbed4 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 4fa1efb1-1488-48f4-a6ec-9b4787e01277] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:34.109845 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-1bd9e428-f60f-4d74-914b-326696acbed4 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:34.113697 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-1bd9e428-f60f-4d74-914b-326696acbed4 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:34.116436 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-1bd9e428-f60f-4d74-914b-326696acbed4 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:34.117350 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-1bd9e428-f60f-4d74-914b-326696acbed4 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:34.267738 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-1bd9e428-f60f-4d74-914b-326696acbed4 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:34.286876 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-1bd9e428-f60f-4d74-914b-326696acbed4 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277" status: 200 len: 1280 microversion: 2.1 time: 0.213006 Jul 19 15:45:34.289177 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 31/53] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:45:34 2022] GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277 => generated 1280 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:45:34.749526 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-b7b5f410-7914-4d93-9aa9-2ca4f3a1a99c tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:34.751970 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-b7b5f410-7914-4d93-9aa9-2ca4f3a1a99c tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: 5f1579c0-907a-490f-ad8e-0fe2db0baf97] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:34.773393 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b7b5f410-7914-4d93-9aa9-2ca4f3a1a99c tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:34.774165 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b7b5f410-7914-4d93-9aa9-2ca4f3a1a99c tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:34.777254 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b7b5f410-7914-4d93-9aa9-2ca4f3a1a99c tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:34.778472 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b7b5f410-7914-4d93-9aa9-2ca4f3a1a99c tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:34.963497 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-b7b5f410-7914-4d93-9aa9-2ca4f3a1a99c tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7c42cf0bc84292bb0b7edb9f2e7fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a72d232f314a78b0e1c3f04b0ed682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:34.979048 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-b7b5f410-7914-4d93-9aa9-2ca4f3a1a99c tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/5f1579c0-907a-490f-ad8e-0fe2db0baf97" status: 200 len: 1298 microversion: 2.1 time: 0.232024 Jul 19 15:45:34.985447 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 32/54] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:45:34 2022] GET /compute/v2.1/servers/5f1579c0-907a-490f-ad8e-0fe2db0baf97 => generated 1298 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:45:35.080114 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-856bd65c-dd4c-4d47-b3b1-2ad5e4ad9f2f tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:35.081055 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-856bd65c-dd4c-4d47-b3b1-2ad5e4ad9f2f tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] [instance: 82a77751-75d6-4aa5-a0d6-cb1af296b4e7] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:35.114582 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-856bd65c-dd4c-4d47-b3b1-2ad5e4ad9f2f tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:35.117468 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-856bd65c-dd4c-4d47-b3b1-2ad5e4ad9f2f tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:35.121515 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-856bd65c-dd4c-4d47-b3b1-2ad5e4ad9f2f tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:35.122985 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-856bd65c-dd4c-4d47-b3b1-2ad5e4ad9f2f tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:35.287697 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-da7aff5c-3d4e-4e9a-b251-a17e4b4c0736 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:35.296551 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-da7aff5c-3d4e-4e9a-b251-a17e4b4c0736 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:35.298105 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-da7aff5c-3d4e-4e9a-b251-a17e4b4c0736 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:35.299278 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-da7aff5c-3d4e-4e9a-b251-a17e4b4c0736 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 200 len: 1406 microversion: 2.20 time: 1.458267 Jul 19 15:45:35.313450 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 23/55] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:45:33 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 1406 bytes in 1473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:45:35.318453 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-f4fc5017-a155-484b-ac7e-89faa4b7de08 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:35.324830 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-f4fc5017-a155-484b-ac7e-89faa4b7de08 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 4fa1efb1-1488-48f4-a6ec-9b4787e01277] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:35.341265 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-f4fc5017-a155-484b-ac7e-89faa4b7de08 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:35.342085 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-f4fc5017-a155-484b-ac7e-89faa4b7de08 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:35.344394 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-f4fc5017-a155-484b-ac7e-89faa4b7de08 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:35.345301 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-f4fc5017-a155-484b-ac7e-89faa4b7de08 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:35.494590 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-856bd65c-dd4c-4d47-b3b1-2ad5e4ad9f2f tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831d1557afd649518d34d4f970f96674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905aecc2e33f4befb1a47740e8d53611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:35.503295 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-856bd65c-dd4c-4d47-b3b1-2ad5e4ad9f2f tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] 10.222.0.64 "GET /compute/v2.1/servers/82a77751-75d6-4aa5-a0d6-cb1af296b4e7" status: 200 len: 1273 microversion: 2.1 time: 0.429818 Jul 19 15:45:35.518812 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 33/56] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:45:35 2022] GET /compute/v2.1/servers/82a77751-75d6-4aa5-a0d6-cb1af296b4e7 => generated 1273 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:45:36.003761 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-e688e1a4-4b89-4d1d-a3df-d363d4b8280b tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:36.004762 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-e688e1a4-4b89-4d1d-a3df-d363d4b8280b tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: 5f1579c0-907a-490f-ad8e-0fe2db0baf97] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:36.021381 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG dbcounter [-] [129520] Writing DB stats nova_cell0:SELECT=6 {{(pid=129520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:36.023670 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-e688e1a4-4b89-4d1d-a3df-d363d4b8280b tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:36.028374 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-e688e1a4-4b89-4d1d-a3df-d363d4b8280b tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:36.029463 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-e688e1a4-4b89-4d1d-a3df-d363d4b8280b tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:36.029823 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-e688e1a4-4b89-4d1d-a3df-d363d4b8280b tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:36.092730 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG dbcounter [-] [129520] Writing DB stats nova_cell1:SELECT=100 {{(pid=129520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:36.353071 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-e688e1a4-4b89-4d1d-a3df-d363d4b8280b tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7c42cf0bc84292bb0b7edb9f2e7fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a72d232f314a78b0e1c3f04b0ed682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:36.376765 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-e688e1a4-4b89-4d1d-a3df-d363d4b8280b tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/5f1579c0-907a-490f-ad8e-0fe2db0baf97" status: 200 len: 1298 microversion: 2.1 time: 0.379390 Jul 19 15:45:36.380276 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 34/57] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:45:35 2022] GET /compute/v2.1/servers/5f1579c0-907a-490f-ad8e-0fe2db0baf97 => generated 1298 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:45:36.399587 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-f4fc5017-a155-484b-ac7e-89faa4b7de08 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:36.409816 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-f4fc5017-a155-484b-ac7e-89faa4b7de08 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277" status: 200 len: 1322 microversion: 2.1 time: 1.094921 Jul 19 15:45:36.412448 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-7fa99f5f-4176-4069-b99b-58d81773a3c3 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:36.416870 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-7fa99f5f-4176-4069-b99b-58d81773a3c3 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:36.417974 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 24/58] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:45:35 2022] GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277 => generated 1322 bytes in 1104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:45:36.433748 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-7fa99f5f-4176-4069-b99b-58d81773a3c3 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:36.435527 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-7fa99f5f-4176-4069-b99b-58d81773a3c3 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:36.438905 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-7fa99f5f-4176-4069-b99b-58d81773a3c3 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:36.440056 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-7fa99f5f-4176-4069-b99b-58d81773a3c3 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:36.522211 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-a295966e-9d79-4173-80c0-050e711cbefb tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:36.523316 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-a295966e-9d79-4173-80c0-050e711cbefb tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] [instance: 82a77751-75d6-4aa5-a0d6-cb1af296b4e7] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:36.536280 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-a295966e-9d79-4173-80c0-050e711cbefb tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:36.540062 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-a295966e-9d79-4173-80c0-050e711cbefb tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:36.542575 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-a295966e-9d79-4173-80c0-050e711cbefb tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:36.547219 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-a295966e-9d79-4173-80c0-050e711cbefb tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:36.925957 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-a295966e-9d79-4173-80c0-050e711cbefb tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831d1557afd649518d34d4f970f96674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905aecc2e33f4befb1a47740e8d53611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:36.940475 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-a295966e-9d79-4173-80c0-050e711cbefb tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] 10.222.0.64 "GET /compute/v2.1/servers/82a77751-75d6-4aa5-a0d6-cb1af296b4e7" status: 200 len: 1315 microversion: 2.1 time: 0.421079 Jul 19 15:45:36.943247 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 25/59] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:45:36 2022] GET /compute/v2.1/servers/82a77751-75d6-4aa5-a0d6-cb1af296b4e7 => generated 1315 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:45:37.088496 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-7fa99f5f-4176-4069-b99b-58d81773a3c3 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:37.110703 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-7fa99f5f-4176-4069-b99b-58d81773a3c3 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:37.112428 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-7fa99f5f-4176-4069-b99b-58d81773a3c3 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:37.120122 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-7fa99f5f-4176-4069-b99b-58d81773a3c3 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 200 len: 1406 microversion: 2.20 time: 0.731616 Jul 19 15:45:37.120962 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 35/60] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:45:36 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 1406 bytes in 740 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:45:37.412041 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-91e63117-e60e-4f0f-97bf-b1d4a206c467 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:37.413605 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-91e63117-e60e-4f0f-97bf-b1d4a206c467 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: 5f1579c0-907a-490f-ad8e-0fe2db0baf97] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:37.437904 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-3cb46bf9-ac88-45e3-a0ad-327b0fa179a7 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:37.440182 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-3cb46bf9-ac88-45e3-a0ad-327b0fa179a7 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 4fa1efb1-1488-48f4-a6ec-9b4787e01277] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:37.457218 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG dbcounter [-] [129520] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=129520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:37.458266 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-91e63117-e60e-4f0f-97bf-b1d4a206c467 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:37.461114 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-91e63117-e60e-4f0f-97bf-b1d4a206c467 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:37.462430 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-3cb46bf9-ac88-45e3-a0ad-327b0fa179a7 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:37.463875 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-91e63117-e60e-4f0f-97bf-b1d4a206c467 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:37.465023 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-3cb46bf9-ac88-45e3-a0ad-327b0fa179a7 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:37.465536 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-91e63117-e60e-4f0f-97bf-b1d4a206c467 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:37.466606 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-3cb46bf9-ac88-45e3-a0ad-327b0fa179a7 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:37.478912 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-3cb46bf9-ac88-45e3-a0ad-327b0fa179a7 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:37.928051 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG dbcounter [-] [129519] Writing DB stats nova_cell0:SELECT=4 {{(pid=129519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:37.994867 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG dbcounter [-] [129519] Writing DB stats nova_cell0:SELECT=22 {{(pid=129519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:38.185376 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-3cb46bf9-ac88-45e3-a0ad-327b0fa179a7 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:38.219358 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-3cb46bf9-ac88-45e3-a0ad-327b0fa179a7 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277" status: 200 len: 1322 microversion: 2.1 time: 0.784577 Jul 19 15:45:38.220885 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 36/61] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:45:37 2022] GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277 => generated 1322 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:45:38.228911 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-3d007b9c-113c-4f88-985c-f270e322f500 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:38.229522 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-3d007b9c-113c-4f88-985c-f270e322f500 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] [instance: 82a77751-75d6-4aa5-a0d6-cb1af296b4e7] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:38.284825 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-3d007b9c-113c-4f88-985c-f270e322f500 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:38.285492 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-3d007b9c-113c-4f88-985c-f270e322f500 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:38.291944 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-3d007b9c-113c-4f88-985c-f270e322f500 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:38.295868 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-3d007b9c-113c-4f88-985c-f270e322f500 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:38.374582 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG dbcounter [-] [129520] Writing DB stats nova_cell0:SELECT=26 {{(pid=129520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:38.462965 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-91e63117-e60e-4f0f-97bf-b1d4a206c467 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7c42cf0bc84292bb0b7edb9f2e7fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a72d232f314a78b0e1c3f04b0ed682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:38.492713 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-91e63117-e60e-4f0f-97bf-b1d4a206c467 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/5f1579c0-907a-490f-ad8e-0fe2db0baf97" status: 200 len: 1366 microversion: 2.1 time: 1.087980 Jul 19 15:45:38.504786 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 26/62] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:45:37 2022] GET /compute/v2.1/servers/5f1579c0-907a-490f-ad8e-0fe2db0baf97 => generated 1366 bytes in 1101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:45:38.517508 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-c0005189-9b60-4e5c-a375-30a7591237dd tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:38.540255 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-c0005189-9b60-4e5c-a375-30a7591237dd tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:38.570999 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-c0005189-9b60-4e5c-a375-30a7591237dd tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:38.572179 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-c0005189-9b60-4e5c-a375-30a7591237dd tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:38.573313 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-c0005189-9b60-4e5c-a375-30a7591237dd tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:38.574020 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-c0005189-9b60-4e5c-a375-30a7591237dd tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:39.027407 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-3d007b9c-113c-4f88-985c-f270e322f500 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831d1557afd649518d34d4f970f96674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905aecc2e33f4befb1a47740e8d53611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:39.049246 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-3d007b9c-113c-4f88-985c-f270e322f500 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] 10.222.0.64 "GET /compute/v2.1/servers/82a77751-75d6-4aa5-a0d6-cb1af296b4e7" status: 200 len: 1315 microversion: 2.1 time: 0.826787 Jul 19 15:45:39.068538 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 37/63] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:45:38 2022] GET /compute/v2.1/servers/82a77751-75d6-4aa5-a0d6-cb1af296b4e7 => generated 1315 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:45:39.238447 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-b6f9572f-1837-4578-bd5a-774fe990a303 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:39.240535 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-b6f9572f-1837-4578-bd5a-774fe990a303 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 4fa1efb1-1488-48f4-a6ec-9b4787e01277] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:39.259686 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b6f9572f-1837-4578-bd5a-774fe990a303 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:39.260381 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b6f9572f-1837-4578-bd5a-774fe990a303 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:39.263754 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b6f9572f-1837-4578-bd5a-774fe990a303 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:39.264544 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b6f9572f-1837-4578-bd5a-774fe990a303 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:40.015623 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-b6f9572f-1837-4578-bd5a-774fe990a303 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:40.028829 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-b6f9572f-1837-4578-bd5a-774fe990a303 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277" status: 200 len: 1322 microversion: 2.1 time: 0.791356 Jul 19 15:45:40.033640 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 38/64] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:45:39 2022] GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277 => generated 1322 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:45:40.044783 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-1d086728-a69e-47bd-830a-fbf3e711b54f tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:40.049237 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-1d086728-a69e-47bd-830a-fbf3e711b54f tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: 5f1579c0-907a-490f-ad8e-0fe2db0baf97] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:40.068924 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-1d086728-a69e-47bd-830a-fbf3e711b54f tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:40.074474 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-1d086728-a69e-47bd-830a-fbf3e711b54f tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:40.075989 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-1d086728-a69e-47bd-830a-fbf3e711b54f tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:40.077492 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-1d086728-a69e-47bd-830a-fbf3e711b54f tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:40.601006 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-1d086728-a69e-47bd-830a-fbf3e711b54f tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7c42cf0bc84292bb0b7edb9f2e7fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a72d232f314a78b0e1c3f04b0ed682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:40.612044 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-1d086728-a69e-47bd-830a-fbf3e711b54f tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/5f1579c0-907a-490f-ad8e-0fe2db0baf97" status: 200 len: 1366 microversion: 2.1 time: 0.576361 Jul 19 15:45:40.615182 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 39/65] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:45:40 2022] GET /compute/v2.1/servers/5f1579c0-907a-490f-ad8e-0fe2db0baf97 => generated 1366 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:45:40.629502 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-a6783a09-93e0-40e7-be2c-8f484e25010a tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:40.630147 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-a6783a09-93e0-40e7-be2c-8f484e25010a tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] [instance: 82a77751-75d6-4aa5-a0d6-cb1af296b4e7] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:40.646884 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-a6783a09-93e0-40e7-be2c-8f484e25010a tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:40.646884 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-a6783a09-93e0-40e7-be2c-8f484e25010a tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:40.647277 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-a6783a09-93e0-40e7-be2c-8f484e25010a tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:40.647505 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-a6783a09-93e0-40e7-be2c-8f484e25010a tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:40.773600 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-c0005189-9b60-4e5c-a375-30a7591237dd tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:40.794821 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-c0005189-9b60-4e5c-a375-30a7591237dd tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:40.798080 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-c0005189-9b60-4e5c-a375-30a7591237dd tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:40.804523 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-c0005189-9b60-4e5c-a375-30a7591237dd tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 200 len: 1406 microversion: 2.20 time: 2.298232 Jul 19 15:45:40.814374 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 27/66] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:45:38 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 1406 bytes in 2309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:45:41.054188 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-9d0fcc6a-3a2d-48e4-8700-990ba549f29e tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:41.055241 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-9d0fcc6a-3a2d-48e4-8700-990ba549f29e tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 4fa1efb1-1488-48f4-a6ec-9b4787e01277] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:41.074520 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-9d0fcc6a-3a2d-48e4-8700-990ba549f29e tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:41.077189 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-9d0fcc6a-3a2d-48e4-8700-990ba549f29e tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:41.079861 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-9d0fcc6a-3a2d-48e4-8700-990ba549f29e tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:41.083632 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-9d0fcc6a-3a2d-48e4-8700-990ba549f29e tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:42.024084 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-a6783a09-93e0-40e7-be2c-8f484e25010a tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831d1557afd649518d34d4f970f96674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905aecc2e33f4befb1a47740e8d53611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:42.033301 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-a6783a09-93e0-40e7-be2c-8f484e25010a tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] 10.222.0.64 "GET /compute/v2.1/servers/82a77751-75d6-4aa5-a0d6-cb1af296b4e7" status: 200 len: 1315 microversion: 2.1 time: 1.408622 Jul 19 15:45:42.049131 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 40/67] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:45:40 2022] GET /compute/v2.1/servers/82a77751-75d6-4aa5-a0d6-cb1af296b4e7 => generated 1315 bytes in 1425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:45:42.057814 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-2c4fe56e-e018-48b8-a0a2-fb06d0c878fe tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:42.068341 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-2c4fe56e-e018-48b8-a0a2-fb06d0c878fe tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: 5f1579c0-907a-490f-ad8e-0fe2db0baf97] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:42.096194 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-2c4fe56e-e018-48b8-a0a2-fb06d0c878fe tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:42.099408 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-2c4fe56e-e018-48b8-a0a2-fb06d0c878fe tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:42.103661 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-2c4fe56e-e018-48b8-a0a2-fb06d0c878fe tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:42.108571 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-2c4fe56e-e018-48b8-a0a2-fb06d0c878fe tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:42.537766 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-9d0fcc6a-3a2d-48e4-8700-990ba549f29e tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:42.549089 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-9d0fcc6a-3a2d-48e4-8700-990ba549f29e tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277" status: 200 len: 1322 microversion: 2.1 time: 1.500128 Jul 19 15:45:42.552095 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 28/68] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:45:41 2022] GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277 => generated 1322 bytes in 1504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:45:42.582189 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-8c0248f7-42f8-4660-9123-a6b72d58d92d tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:42.582906 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-8c0248f7-42f8-4660-9123-a6b72d58d92d tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:42.601095 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-8c0248f7-42f8-4660-9123-a6b72d58d92d tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:42.602046 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-8c0248f7-42f8-4660-9123-a6b72d58d92d tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:42.602875 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-8c0248f7-42f8-4660-9123-a6b72d58d92d tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:42.603317 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-8c0248f7-42f8-4660-9123-a6b72d58d92d tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:43.180667 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-2c4fe56e-e018-48b8-a0a2-fb06d0c878fe tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7c42cf0bc84292bb0b7edb9f2e7fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a72d232f314a78b0e1c3f04b0ed682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:43.191472 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-2c4fe56e-e018-48b8-a0a2-fb06d0c878fe tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/5f1579c0-907a-490f-ad8e-0fe2db0baf97" status: 200 len: 1366 microversion: 2.1 time: 1.140775 Jul 19 15:45:43.196301 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 41/69] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:45:42 2022] GET /compute/v2.1/servers/5f1579c0-907a-490f-ad8e-0fe2db0baf97 => generated 1366 bytes in 1146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:45:43.205337 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-e2b1bc81-b890-4423-94bd-153af43082a3 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:43.217488 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-e2b1bc81-b890-4423-94bd-153af43082a3 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] [instance: 82a77751-75d6-4aa5-a0d6-cb1af296b4e7] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:43.246622 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-e2b1bc81-b890-4423-94bd-153af43082a3 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:43.249094 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-e2b1bc81-b890-4423-94bd-153af43082a3 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:43.251117 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-e2b1bc81-b890-4423-94bd-153af43082a3 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:43.254759 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-e2b1bc81-b890-4423-94bd-153af43082a3 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:43.521847 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-8c0248f7-42f8-4660-9123-a6b72d58d92d tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:43.536656 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG dbcounter [-] [129519] Writing DB stats nova_cell1:SELECT=100 {{(pid=129519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:43.568881 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-8c0248f7-42f8-4660-9123-a6b72d58d92d tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:43.571942 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-8c0248f7-42f8-4660-9123-a6b72d58d92d tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:43.580604 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-8c0248f7-42f8-4660-9123-a6b72d58d92d tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 200 len: 1406 microversion: 2.20 time: 1.011273 Jul 19 15:45:43.586637 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 29/70] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:45:42 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 1406 bytes in 1034 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:45:43.601496 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-cfdee087-2881-410b-b65a-bbffa031c246 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:43.604711 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-cfdee087-2881-410b-b65a-bbffa031c246 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 4fa1efb1-1488-48f4-a6ec-9b4787e01277] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:43.629284 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-cfdee087-2881-410b-b65a-bbffa031c246 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:43.632385 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-cfdee087-2881-410b-b65a-bbffa031c246 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:43.633807 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-cfdee087-2881-410b-b65a-bbffa031c246 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:43.636565 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-cfdee087-2881-410b-b65a-bbffa031c246 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:45.108988 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-e2b1bc81-b890-4423-94bd-153af43082a3 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831d1557afd649518d34d4f970f96674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905aecc2e33f4befb1a47740e8d53611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:45.126915 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-e2b1bc81-b890-4423-94bd-153af43082a3 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] 10.222.0.64 "GET /compute/v2.1/servers/82a77751-75d6-4aa5-a0d6-cb1af296b4e7" status: 200 len: 1315 microversion: 2.1 time: 1.927111 Jul 19 15:45:45.127467 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 42/71] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:45:43 2022] GET /compute/v2.1/servers/82a77751-75d6-4aa5-a0d6-cb1af296b4e7 => generated 1315 bytes in 1928 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:45:45.147284 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-55a3459e-bca8-45c1-889e-c7dfa10c4079 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:45.153229 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-55a3459e-bca8-45c1-889e-c7dfa10c4079 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: 5f1579c0-907a-490f-ad8e-0fe2db0baf97] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:45.179121 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-55a3459e-bca8-45c1-889e-c7dfa10c4079 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:45.179617 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-55a3459e-bca8-45c1-889e-c7dfa10c4079 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:45.180479 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-55a3459e-bca8-45c1-889e-c7dfa10c4079 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:45.184622 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-55a3459e-bca8-45c1-889e-c7dfa10c4079 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:45.239787 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-cfdee087-2881-410b-b65a-bbffa031c246 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:45.254971 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-cfdee087-2881-410b-b65a-bbffa031c246 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277" status: 200 len: 1322 microversion: 2.1 time: 1.661298 Jul 19 15:45:45.257678 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 30/72] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:45:43 2022] GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277 => generated 1322 bytes in 1667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:45:45.565141 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [req-e22addaf-54e9-417b-8a2f-8296eb329b64 req-0e82e57d-7c01-4cc7-807d-cd942b5effad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f1579c0-907a-490f-ad8e-0fe2db0baf97", "tag": "c75827cb-3014-46a1-a3d9-1c24d0e5f8f7"}]} {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:45:45.592025 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [req-e22addaf-54e9-417b-8a2f-8296eb329b64 req-0e82e57d-7c01-4cc7-807d-cd942b5effad service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:45.592493 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [req-e22addaf-54e9-417b-8a2f-8296eb329b64 req-0e82e57d-7c01-4cc7-807d-cd942b5effad service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:45.645565 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.compute.server_external_events [req-e22addaf-54e9-417b-8a2f-8296eb329b64 req-0e82e57d-7c01-4cc7-807d-cd942b5effad service nova] Creating event network-changed:c75827cb-3014-46a1-a3d9-1c24d0e5f8f7 for instance 5f1579c0-907a-490f-ad8e-0fe2db0baf97 on hv-cinder-84902 Jul 19 15:45:45.647194 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [req-e22addaf-54e9-417b-8a2f-8296eb329b64 req-0e82e57d-7c01-4cc7-807d-cd942b5effad service nova] Acquired lock "compute-rpcapi-router" {{(pid=129519) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 19 15:45:45.651180 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-2f7f3d2e-a9e0-42a8-9578-a74c235ac277 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:45.652741 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-2f7f3d2e-a9e0-42a8-9578-a74c235ac277 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:45.653512 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-2f7f3d2e-a9e0-42a8-9578-a74c235ac277 None None] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:45.655745 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-2f7f3d2e-a9e0-42a8-9578-a74c235ac277 None None] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:45.693338 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.compute.rpcapi [None req-2f7f3d2e-a9e0-42a8-9578-a74c235ac277 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 19 15:45:45.694789 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-2f7f3d2e-a9e0-42a8-9578-a74c235ac277 None None] Releasing lock "compute-rpcapi-router" {{(pid=129519) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 19 15:45:45.738910 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-2f7f3d2e-a9e0-42a8-9578-a74c235ac277 None None] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.479523 Jul 19 15:45:45.740833 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 31/73] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Jul 19 15:45:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:45:45.807092 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-55a3459e-bca8-45c1-889e-c7dfa10c4079 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7c42cf0bc84292bb0b7edb9f2e7fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a72d232f314a78b0e1c3f04b0ed682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:45.825603 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-55a3459e-bca8-45c1-889e-c7dfa10c4079 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/5f1579c0-907a-490f-ad8e-0fe2db0baf97" status: 200 len: 1366 microversion: 2.1 time: 0.695558 Jul 19 15:45:45.827772 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 43/74] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:45:45 2022] GET /compute/v2.1/servers/5f1579c0-907a-490f-ad8e-0fe2db0baf97 => generated 1366 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:45:45.847711 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-90be5100-f9ce-4a5f-bd84-52b2aff1fac5 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:45.851354 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-90be5100-f9ce-4a5f-bd84-52b2aff1fac5 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:45.878887 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-90be5100-f9ce-4a5f-bd84-52b2aff1fac5 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:45.882208 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-90be5100-f9ce-4a5f-bd84-52b2aff1fac5 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:45.884117 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-90be5100-f9ce-4a5f-bd84-52b2aff1fac5 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:45.886329 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-90be5100-f9ce-4a5f-bd84-52b2aff1fac5 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:45.897413 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [req-8d3227df-d3a3-43c7-b70f-0b3735d001d4 req-1b9d80d4-0029-46e4-b978-17f690485b26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "82a77751-75d6-4aa5-a0d6-cb1af296b4e7", "tag": "8cd72be0-aaa1-41b3-a6d5-52edc3f63b70"}]} {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:45:45.918221 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [req-8d3227df-d3a3-43c7-b70f-0b3735d001d4 req-1b9d80d4-0029-46e4-b978-17f690485b26 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:45.922312 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [req-8d3227df-d3a3-43c7-b70f-0b3735d001d4 req-1b9d80d4-0029-46e4-b978-17f690485b26 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:45.959500 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.compute.server_external_events [req-8d3227df-d3a3-43c7-b70f-0b3735d001d4 req-1b9d80d4-0029-46e4-b978-17f690485b26 service nova] Creating event network-changed:8cd72be0-aaa1-41b3-a6d5-52edc3f63b70 for instance 82a77751-75d6-4aa5-a0d6-cb1af296b4e7 on hv-cinder-84902 Jul 19 15:45:45.974332 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [req-8d3227df-d3a3-43c7-b70f-0b3735d001d4 req-1b9d80d4-0029-46e4-b978-17f690485b26 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.232002 Jul 19 15:45:45.975650 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 32/75] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Jul 19 15:45:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:45:46.153163 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-8f3db112-a245-4bcc-8545-a16327741b46 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:46.153870 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-8f3db112-a245-4bcc-8545-a16327741b46 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] [instance: 82a77751-75d6-4aa5-a0d6-cb1af296b4e7] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:46.169099 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-8f3db112-a245-4bcc-8545-a16327741b46 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:46.169512 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-8f3db112-a245-4bcc-8545-a16327741b46 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:46.170957 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-8f3db112-a245-4bcc-8545-a16327741b46 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:46.171628 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-8f3db112-a245-4bcc-8545-a16327741b46 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:46.485116 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-90be5100-f9ce-4a5f-bd84-52b2aff1fac5 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:46.500855 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-90be5100-f9ce-4a5f-bd84-52b2aff1fac5 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:46.507993 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-90be5100-f9ce-4a5f-bd84-52b2aff1fac5 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:46.507993 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-90be5100-f9ce-4a5f-bd84-52b2aff1fac5 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 200 len: 1406 microversion: 2.20 time: 0.676903 Jul 19 15:45:46.523312 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 44/76] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:45:45 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 1406 bytes in 694 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:45:46.533525 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-ff19b2be-865e-462f-9061-53f0158b2493 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:46.536033 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-ff19b2be-865e-462f-9061-53f0158b2493 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 4fa1efb1-1488-48f4-a6ec-9b4787e01277] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:46.567041 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-ff19b2be-865e-462f-9061-53f0158b2493 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:46.569903 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-ff19b2be-865e-462f-9061-53f0158b2493 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:46.574309 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-ff19b2be-865e-462f-9061-53f0158b2493 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:46.574967 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-ff19b2be-865e-462f-9061-53f0158b2493 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:46.654217 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-8f3db112-a245-4bcc-8545-a16327741b46 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831d1557afd649518d34d4f970f96674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905aecc2e33f4befb1a47740e8d53611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:46.662101 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-8f3db112-a245-4bcc-8545-a16327741b46 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] 10.222.0.64 "GET /compute/v2.1/servers/82a77751-75d6-4aa5-a0d6-cb1af296b4e7" status: 200 len: 1315 microversion: 2.1 time: 0.513993 Jul 19 15:45:46.662715 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 33/77] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:45:46 2022] GET /compute/v2.1/servers/82a77751-75d6-4aa5-a0d6-cb1af296b4e7 => generated 1315 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:45:46.779733 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-ff19b2be-865e-462f-9061-53f0158b2493 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:46.788981 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-ff19b2be-865e-462f-9061-53f0158b2493 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277" status: 200 len: 1322 microversion: 2.1 time: 0.264522 Jul 19 15:45:46.790006 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 45/78] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:45:46 2022] GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277 => generated 1322 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:45:46.845195 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-eaaac388-2b09-46f0-99ca-d12f107a39c4 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:46.846114 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-eaaac388-2b09-46f0-99ca-d12f107a39c4 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: 5f1579c0-907a-490f-ad8e-0fe2db0baf97] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:46.852393 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-eaaac388-2b09-46f0-99ca-d12f107a39c4 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:46.852923 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-eaaac388-2b09-46f0-99ca-d12f107a39c4 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:46.853823 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-eaaac388-2b09-46f0-99ca-d12f107a39c4 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:46.854377 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-eaaac388-2b09-46f0-99ca-d12f107a39c4 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:47.005156 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-eaaac388-2b09-46f0-99ca-d12f107a39c4 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7c42cf0bc84292bb0b7edb9f2e7fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a72d232f314a78b0e1c3f04b0ed682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:47.013054 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-eaaac388-2b09-46f0-99ca-d12f107a39c4 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/5f1579c0-907a-490f-ad8e-0fe2db0baf97" status: 200 len: 1366 microversion: 2.1 time: 0.172602 Jul 19 15:45:47.013614 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 34/79] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:45:46 2022] GET /compute/v2.1/servers/5f1579c0-907a-490f-ad8e-0fe2db0baf97 => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:45:47.525957 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-1fd7219d-6c7b-4586-bb78-c602a550ca95 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:47.526709 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-1fd7219d-6c7b-4586-bb78-c602a550ca95 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:47.533105 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-1fd7219d-6c7b-4586-bb78-c602a550ca95 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:47.533626 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-1fd7219d-6c7b-4586-bb78-c602a550ca95 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:47.534479 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-1fd7219d-6c7b-4586-bb78-c602a550ca95 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:47.535243 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-1fd7219d-6c7b-4586-bb78-c602a550ca95 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:47.680320 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-58425cc5-3457-4ed7-899a-f2cf960addef tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:47.680928 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-58425cc5-3457-4ed7-899a-f2cf960addef tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] [instance: 82a77751-75d6-4aa5-a0d6-cb1af296b4e7] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:47.681113 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-1fd7219d-6c7b-4586-bb78-c602a550ca95 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:47.691993 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-58425cc5-3457-4ed7-899a-f2cf960addef tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:47.692510 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-1fd7219d-6c7b-4586-bb78-c602a550ca95 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:47.694062 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-1fd7219d-6c7b-4586-bb78-c602a550ca95 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:47.695266 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-1fd7219d-6c7b-4586-bb78-c602a550ca95 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 200 len: 1406 microversion: 2.20 time: 0.173178 Jul 19 15:45:47.695810 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 46/80] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:45:47 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 1406 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:45:47.701890 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-58425cc5-3457-4ed7-899a-f2cf960addef tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:47.701890 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-58425cc5-3457-4ed7-899a-f2cf960addef tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:47.701890 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-58425cc5-3457-4ed7-899a-f2cf960addef tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:47.753812 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [req-fa35ccf5-91e3-48a5-ab88-94656980ad2e req-1f8e035f-98a5-480d-bae4-e4cf4c7b64e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4fa1efb1-1488-48f4-a6ec-9b4787e01277", "tag": "5e64b358-ca05-4217-81f6-26f217876ab3"}, {"name": "network-changed", "server_uuid": "3eeb4a51-a06c-4faf-9a63-bf3658ca773b", "tag": "61483d93-6fa5-46d1-b820-a274f98ffcbb"}]} {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:45:47.767521 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [req-fa35ccf5-91e3-48a5-ab88-94656980ad2e req-1f8e035f-98a5-480d-bae4-e4cf4c7b64e7 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:47.768770 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [req-fa35ccf5-91e3-48a5-ab88-94656980ad2e req-1f8e035f-98a5-480d-bae4-e4cf4c7b64e7 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:47.795703 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.compute.server_external_events [req-fa35ccf5-91e3-48a5-ab88-94656980ad2e req-1f8e035f-98a5-480d-bae4-e4cf4c7b64e7 service nova] Creating event network-changed:5e64b358-ca05-4217-81f6-26f217876ab3 for instance 4fa1efb1-1488-48f4-a6ec-9b4787e01277 on hv-cinder-84902 Jul 19 15:45:47.796337 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.compute.server_external_events [req-fa35ccf5-91e3-48a5-ab88-94656980ad2e req-1f8e035f-98a5-480d-bae4-e4cf4c7b64e7 service nova] Creating event network-changed:61483d93-6fa5-46d1-b820-a274f98ffcbb for instance 3eeb4a51-a06c-4faf-9a63-bf3658ca773b on hv-cinder-84902 Jul 19 15:45:47.796933 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [req-fa35ccf5-91e3-48a5-ab88-94656980ad2e req-1f8e035f-98a5-480d-bae4-e4cf4c7b64e7 service nova] Acquired lock "compute-rpcapi-router" {{(pid=129520) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 19 15:45:47.798561 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-8488d6dc-2487-4972-8c0d-9e405101da79 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:47.799170 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-8488d6dc-2487-4972-8c0d-9e405101da79 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:47.800166 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-8488d6dc-2487-4972-8c0d-9e405101da79 None None] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:47.800593 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-8488d6dc-2487-4972-8c0d-9e405101da79 None None] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:47.818351 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.compute.rpcapi [None req-8488d6dc-2487-4972-8c0d-9e405101da79 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 19 15:45:47.819854 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-8488d6dc-2487-4972-8c0d-9e405101da79 None None] Releasing lock "compute-rpcapi-router" {{(pid=129520) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 19 15:45:47.837845 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-8488d6dc-2487-4972-8c0d-9e405101da79 None None] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.087674 Jul 19 15:45:47.838649 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 47/81] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Jul 19 15:45:47 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 15:45:47.848348 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-f9892890-1870-4e0c-a7ce-f6cc2b31616e tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:47.848937 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-f9892890-1870-4e0c-a7ce-f6cc2b31616e tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 4fa1efb1-1488-48f4-a6ec-9b4787e01277] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:47.851329 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-58425cc5-3457-4ed7-899a-f2cf960addef tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831d1557afd649518d34d4f970f96674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905aecc2e33f4befb1a47740e8d53611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:47.855799 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-f9892890-1870-4e0c-a7ce-f6cc2b31616e tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:47.856255 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-f9892890-1870-4e0c-a7ce-f6cc2b31616e tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:47.857030 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-f9892890-1870-4e0c-a7ce-f6cc2b31616e tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:47.857465 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-f9892890-1870-4e0c-a7ce-f6cc2b31616e tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:47.859607 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-58425cc5-3457-4ed7-899a-f2cf960addef tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] 10.222.0.64 "GET /compute/v2.1/servers/82a77751-75d6-4aa5-a0d6-cb1af296b4e7" status: 200 len: 1315 microversion: 2.1 time: 0.183596 Jul 19 15:45:47.860275 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 35/82] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:45:47 2022] GET /compute/v2.1/servers/82a77751-75d6-4aa5-a0d6-cb1af296b4e7 => generated 1315 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:45:48.031823 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-07af700c-a36c-4a9f-ac7c-767d22f7ebf3 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:48.032467 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-07af700c-a36c-4a9f-ac7c-767d22f7ebf3 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: 5f1579c0-907a-490f-ad8e-0fe2db0baf97] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:48.040625 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-07af700c-a36c-4a9f-ac7c-767d22f7ebf3 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:48.041106 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-07af700c-a36c-4a9f-ac7c-767d22f7ebf3 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:48.041826 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-07af700c-a36c-4a9f-ac7c-767d22f7ebf3 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:48.042449 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-07af700c-a36c-4a9f-ac7c-767d22f7ebf3 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:48.176720 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-f9892890-1870-4e0c-a7ce-f6cc2b31616e tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:48.185977 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-f9892890-1870-4e0c-a7ce-f6cc2b31616e tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277" status: 200 len: 1322 microversion: 2.1 time: 0.345625 Jul 19 15:45:48.186795 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 48/83] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:45:47 2022] GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277 => generated 1322 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:45:48.191891 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [req-42d5f585-09a9-46e3-8add-88111375669f req-6432175f-97b0-4069-b1a3-fd2eecce8c09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "764ab5a7-4ebb-4d76-a34b-5f311883bcbe", "tag": "e7989e60-2708-4f38-9de4-2ddeed675e74"}]} {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:45:48.200530 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [req-42d5f585-09a9-46e3-8add-88111375669f req-6432175f-97b0-4069-b1a3-fd2eecce8c09 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:48.200964 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [req-42d5f585-09a9-46e3-8add-88111375669f req-6432175f-97b0-4069-b1a3-fd2eecce8c09 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:48.210302 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-07af700c-a36c-4a9f-ac7c-767d22f7ebf3 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7c42cf0bc84292bb0b7edb9f2e7fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a72d232f314a78b0e1c3f04b0ed682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:48.219545 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-07af700c-a36c-4a9f-ac7c-767d22f7ebf3 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/5f1579c0-907a-490f-ad8e-0fe2db0baf97" status: 200 len: 1366 microversion: 2.1 time: 0.192554 Jul 19 15:45:48.219780 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.compute.server_external_events [req-42d5f585-09a9-46e3-8add-88111375669f req-6432175f-97b0-4069-b1a3-fd2eecce8c09 service nova] Creating event network-changed:e7989e60-2708-4f38-9de4-2ddeed675e74 for instance 764ab5a7-4ebb-4d76-a34b-5f311883bcbe on hv-cinder-84902 Jul 19 15:45:48.220339 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 36/84] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:45:48 2022] GET /compute/v2.1/servers/5f1579c0-907a-490f-ad8e-0fe2db0baf97 => generated 1366 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:45:48.224743 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [req-42d5f585-09a9-46e3-8add-88111375669f req-6432175f-97b0-4069-b1a3-fd2eecce8c09 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036637 Jul 19 15:45:48.225326 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 49/85] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Jul 19 15:45:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:45:48.712813 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-536c4566-2997-4854-9272-a18f8292e1aa tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:48.713422 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-536c4566-2997-4854-9272-a18f8292e1aa tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:48.724107 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-536c4566-2997-4854-9272-a18f8292e1aa tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:48.724107 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-536c4566-2997-4854-9272-a18f8292e1aa tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:48.724107 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-536c4566-2997-4854-9272-a18f8292e1aa tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:48.724107 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-536c4566-2997-4854-9272-a18f8292e1aa tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:48.856637 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-536c4566-2997-4854-9272-a18f8292e1aa tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:48.867266 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-536c4566-2997-4854-9272-a18f8292e1aa tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:48.868781 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-536c4566-2997-4854-9272-a18f8292e1aa tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:48.870088 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-536c4566-2997-4854-9272-a18f8292e1aa tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 200 len: 1406 microversion: 2.20 time: 0.161063 Jul 19 15:45:48.874703 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 37/86] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:45:48 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:45:48.878034 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-ec0732a1-dbba-4b15-8e19-697251d865ad tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:48.878755 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-ec0732a1-dbba-4b15-8e19-697251d865ad tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] [instance: 82a77751-75d6-4aa5-a0d6-cb1af296b4e7] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:48.885086 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-ec0732a1-dbba-4b15-8e19-697251d865ad tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:48.885521 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-ec0732a1-dbba-4b15-8e19-697251d865ad tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:48.886483 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-ec0732a1-dbba-4b15-8e19-697251d865ad tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:48.886912 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-ec0732a1-dbba-4b15-8e19-697251d865ad tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:49.025664 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-ec0732a1-dbba-4b15-8e19-697251d865ad tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831d1557afd649518d34d4f970f96674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905aecc2e33f4befb1a47740e8d53611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:49.034224 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-ec0732a1-dbba-4b15-8e19-697251d865ad tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] 10.222.0.64 "GET /compute/v2.1/servers/82a77751-75d6-4aa5-a0d6-cb1af296b4e7" status: 200 len: 1315 microversion: 2.1 time: 0.161117 Jul 19 15:45:49.035100 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 50/87] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:45:48 2022] GET /compute/v2.1/servers/82a77751-75d6-4aa5-a0d6-cb1af296b4e7 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:45:49.202701 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-dbdad2d5-b27f-478c-a03a-5b7257738a6d tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:49.203316 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-dbdad2d5-b27f-478c-a03a-5b7257738a6d tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 4fa1efb1-1488-48f4-a6ec-9b4787e01277] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:49.209705 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-dbdad2d5-b27f-478c-a03a-5b7257738a6d tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:49.210266 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-dbdad2d5-b27f-478c-a03a-5b7257738a6d tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:49.211142 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-dbdad2d5-b27f-478c-a03a-5b7257738a6d tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:49.211576 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-dbdad2d5-b27f-478c-a03a-5b7257738a6d tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:49.239440 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-278b9c79-934a-4afb-b53a-c440952a2cf7 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:49.240418 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-278b9c79-934a-4afb-b53a-c440952a2cf7 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: 5f1579c0-907a-490f-ad8e-0fe2db0baf97] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:49.249936 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-278b9c79-934a-4afb-b53a-c440952a2cf7 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:49.250740 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-278b9c79-934a-4afb-b53a-c440952a2cf7 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:49.251746 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-278b9c79-934a-4afb-b53a-c440952a2cf7 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:49.252384 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-278b9c79-934a-4afb-b53a-c440952a2cf7 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:49.356263 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-dbdad2d5-b27f-478c-a03a-5b7257738a6d tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:49.365014 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-dbdad2d5-b27f-478c-a03a-5b7257738a6d tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277" status: 200 len: 1322 microversion: 2.1 time: 0.166072 Jul 19 15:45:49.365594 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 38/88] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:45:49 2022] GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277 => generated 1322 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:45:49.414545 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-278b9c79-934a-4afb-b53a-c440952a2cf7 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7c42cf0bc84292bb0b7edb9f2e7fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a72d232f314a78b0e1c3f04b0ed682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:49.423558 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-278b9c79-934a-4afb-b53a-c440952a2cf7 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/5f1579c0-907a-490f-ad8e-0fe2db0baf97" status: 200 len: 1366 microversion: 2.1 time: 0.190555 Jul 19 15:45:49.432375 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 51/89] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:45:49 2022] GET /compute/v2.1/servers/5f1579c0-907a-490f-ad8e-0fe2db0baf97 => generated 1366 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:45:49.888510 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-7c392a51-a178-43e6-8588-316f2711e05b tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:49.890573 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-7c392a51-a178-43e6-8588-316f2711e05b tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:49.897592 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-7c392a51-a178-43e6-8588-316f2711e05b tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:49.898038 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-7c392a51-a178-43e6-8588-316f2711e05b tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:49.898835 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-7c392a51-a178-43e6-8588-316f2711e05b tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:49.899272 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-7c392a51-a178-43e6-8588-316f2711e05b tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:50.046954 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-7c392a51-a178-43e6-8588-316f2711e05b tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:50.052681 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-a78c7160-b92a-46c0-9136-b1c9895a504e tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:50.053376 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-a78c7160-b92a-46c0-9136-b1c9895a504e tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] [instance: 82a77751-75d6-4aa5-a0d6-cb1af296b4e7] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:50.055590 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-7c392a51-a178-43e6-8588-316f2711e05b tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:50.057186 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-7c392a51-a178-43e6-8588-316f2711e05b tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:50.058505 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-7c392a51-a178-43e6-8588-316f2711e05b tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 200 len: 1406 microversion: 2.20 time: 0.173927 Jul 19 15:45:50.059312 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 39/90] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:45:49 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 1406 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:45:50.059698 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-a78c7160-b92a-46c0-9136-b1c9895a504e tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:50.060205 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-a78c7160-b92a-46c0-9136-b1c9895a504e tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:50.061571 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-a78c7160-b92a-46c0-9136-b1c9895a504e tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:50.062014 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-a78c7160-b92a-46c0-9136-b1c9895a504e tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:50.066226 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG dbcounter [-] [129520] Writing DB stats nova_cell1:SELECT=100 {{(pid=129520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:50.204689 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-a78c7160-b92a-46c0-9136-b1c9895a504e tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831d1557afd649518d34d4f970f96674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905aecc2e33f4befb1a47740e8d53611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:50.215458 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-a78c7160-b92a-46c0-9136-b1c9895a504e tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] 10.222.0.64 "GET /compute/v2.1/servers/82a77751-75d6-4aa5-a0d6-cb1af296b4e7" status: 200 len: 1315 microversion: 2.1 time: 0.167079 Jul 19 15:45:50.216129 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 52/91] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:45:50 2022] GET /compute/v2.1/servers/82a77751-75d6-4aa5-a0d6-cb1af296b4e7 => generated 1315 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:45:50.382563 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-7d300faa-41cd-4a6b-bfa6-0cfa707424b8 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:50.383170 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-7d300faa-41cd-4a6b-bfa6-0cfa707424b8 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 4fa1efb1-1488-48f4-a6ec-9b4787e01277] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:50.389302 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-7d300faa-41cd-4a6b-bfa6-0cfa707424b8 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:50.389753 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-7d300faa-41cd-4a6b-bfa6-0cfa707424b8 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:50.390548 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-7d300faa-41cd-4a6b-bfa6-0cfa707424b8 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:50.390984 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-7d300faa-41cd-4a6b-bfa6-0cfa707424b8 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:50.440894 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-d6404341-05ed-4b65-aa31-2bff7a589d8d tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:50.442143 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-d6404341-05ed-4b65-aa31-2bff7a589d8d tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: 5f1579c0-907a-490f-ad8e-0fe2db0baf97] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:50.448281 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-d6404341-05ed-4b65-aa31-2bff7a589d8d tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:50.449013 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-d6404341-05ed-4b65-aa31-2bff7a589d8d tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:50.450403 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-d6404341-05ed-4b65-aa31-2bff7a589d8d tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:50.452737 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-d6404341-05ed-4b65-aa31-2bff7a589d8d tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:50.563028 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-7d300faa-41cd-4a6b-bfa6-0cfa707424b8 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:50.573041 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-7d300faa-41cd-4a6b-bfa6-0cfa707424b8 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277" status: 200 len: 1322 microversion: 2.1 time: 0.194273 Jul 19 15:45:50.583459 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 40/92] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:45:50 2022] GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277 => generated 1322 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:45:50.618108 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-d6404341-05ed-4b65-aa31-2bff7a589d8d tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7c42cf0bc84292bb0b7edb9f2e7fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a72d232f314a78b0e1c3f04b0ed682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:50.626525 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-d6404341-05ed-4b65-aa31-2bff7a589d8d tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/5f1579c0-907a-490f-ad8e-0fe2db0baf97" status: 200 len: 1366 microversion: 2.1 time: 0.189224 Jul 19 15:45:50.627205 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 53/93] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:45:50 2022] GET /compute/v2.1/servers/5f1579c0-907a-490f-ad8e-0fe2db0baf97 => generated 1366 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:45:51.078392 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-0a568f77-8311-49a6-a237-031322d02a07 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:51.080171 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-0a568f77-8311-49a6-a237-031322d02a07 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:51.086537 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-0a568f77-8311-49a6-a237-031322d02a07 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:51.087079 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-0a568f77-8311-49a6-a237-031322d02a07 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:51.087915 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-0a568f77-8311-49a6-a237-031322d02a07 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:51.088536 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-0a568f77-8311-49a6-a237-031322d02a07 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:51.236584 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-466ec0da-673f-45b1-a982-f69ccd7c09e8 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:51.237926 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-466ec0da-673f-45b1-a982-f69ccd7c09e8 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] [instance: 82a77751-75d6-4aa5-a0d6-cb1af296b4e7] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:51.245387 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-466ec0da-673f-45b1-a982-f69ccd7c09e8 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:51.246120 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-466ec0da-673f-45b1-a982-f69ccd7c09e8 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:51.247383 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-466ec0da-673f-45b1-a982-f69ccd7c09e8 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:51.248025 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-466ec0da-673f-45b1-a982-f69ccd7c09e8 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:51.322298 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-0a568f77-8311-49a6-a237-031322d02a07 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:51.333929 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-0a568f77-8311-49a6-a237-031322d02a07 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:51.339082 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-0a568f77-8311-49a6-a237-031322d02a07 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:51.343024 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-0a568f77-8311-49a6-a237-031322d02a07 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 200 len: 1406 microversion: 2.20 time: 0.268844 Jul 19 15:45:51.343810 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 41/94] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:45:51 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 1406 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:45:51.509164 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-466ec0da-673f-45b1-a982-f69ccd7c09e8 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831d1557afd649518d34d4f970f96674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905aecc2e33f4befb1a47740e8d53611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:51.518003 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-466ec0da-673f-45b1-a982-f69ccd7c09e8 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] 10.222.0.64 "GET /compute/v2.1/servers/82a77751-75d6-4aa5-a0d6-cb1af296b4e7" status: 200 len: 1315 microversion: 2.1 time: 0.288462 Jul 19 15:45:51.518940 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 54/95] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:45:51 2022] GET /compute/v2.1/servers/82a77751-75d6-4aa5-a0d6-cb1af296b4e7 => generated 1315 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:45:51.590058 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-93a045e1-f3f5-4afd-aff9-d1aa60e73421 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:51.592813 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-93a045e1-f3f5-4afd-aff9-d1aa60e73421 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 4fa1efb1-1488-48f4-a6ec-9b4787e01277] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:51.599115 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-93a045e1-f3f5-4afd-aff9-d1aa60e73421 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:51.599848 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-93a045e1-f3f5-4afd-aff9-d1aa60e73421 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:51.600826 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-93a045e1-f3f5-4afd-aff9-d1aa60e73421 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:51.601399 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-93a045e1-f3f5-4afd-aff9-d1aa60e73421 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:51.647634 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-e0bbd89d-90ab-48c5-930c-8e9fed33e5e0 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:51.648834 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-e0bbd89d-90ab-48c5-930c-8e9fed33e5e0 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: 5f1579c0-907a-490f-ad8e-0fe2db0baf97] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:51.658743 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-e0bbd89d-90ab-48c5-930c-8e9fed33e5e0 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:51.659474 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-e0bbd89d-90ab-48c5-930c-8e9fed33e5e0 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:51.661103 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-e0bbd89d-90ab-48c5-930c-8e9fed33e5e0 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:51.661940 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-e0bbd89d-90ab-48c5-930c-8e9fed33e5e0 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:51.893281 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-93a045e1-f3f5-4afd-aff9-d1aa60e73421 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:51.907758 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-93a045e1-f3f5-4afd-aff9-d1aa60e73421 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277" status: 200 len: 1322 microversion: 2.1 time: 0.318085 Jul 19 15:45:51.908976 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 42/96] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:45:51 2022] GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277 => generated 1322 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:45:51.956058 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-e0bbd89d-90ab-48c5-930c-8e9fed33e5e0 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7c42cf0bc84292bb0b7edb9f2e7fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a72d232f314a78b0e1c3f04b0ed682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:51.966497 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-e0bbd89d-90ab-48c5-930c-8e9fed33e5e0 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/5f1579c0-907a-490f-ad8e-0fe2db0baf97" status: 200 len: 1366 microversion: 2.1 time: 0.324132 Jul 19 15:45:51.966497 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 55/97] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:45:51 2022] GET /compute/v2.1/servers/5f1579c0-907a-490f-ad8e-0fe2db0baf97 => generated 1366 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:45:52.361625 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-864ee510-37be-4513-897b-669b2de3bca3 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:52.362230 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-864ee510-37be-4513-897b-669b2de3bca3 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:52.368320 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-864ee510-37be-4513-897b-669b2de3bca3 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:52.368770 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-864ee510-37be-4513-897b-669b2de3bca3 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:52.369540 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-864ee510-37be-4513-897b-669b2de3bca3 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:52.370040 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-864ee510-37be-4513-897b-669b2de3bca3 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:52.537092 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-a4d45498-5549-42b1-b2fe-23d365a05297 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:52.537707 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-a4d45498-5549-42b1-b2fe-23d365a05297 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] [instance: 82a77751-75d6-4aa5-a0d6-cb1af296b4e7] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:52.546972 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-a4d45498-5549-42b1-b2fe-23d365a05297 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:52.547652 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-a4d45498-5549-42b1-b2fe-23d365a05297 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:52.548608 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-a4d45498-5549-42b1-b2fe-23d365a05297 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:52.549237 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-a4d45498-5549-42b1-b2fe-23d365a05297 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:52.558904 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-864ee510-37be-4513-897b-669b2de3bca3 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:52.573064 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-864ee510-37be-4513-897b-669b2de3bca3 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:52.575804 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-864ee510-37be-4513-897b-669b2de3bca3 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:52.578025 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-864ee510-37be-4513-897b-669b2de3bca3 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 200 len: 1406 microversion: 2.20 time: 0.220578 Jul 19 15:45:52.588577 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 43/98] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:45:52 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 1406 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:45:52.780754 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-a4d45498-5549-42b1-b2fe-23d365a05297 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831d1557afd649518d34d4f970f96674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905aecc2e33f4befb1a47740e8d53611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:52.791055 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-a4d45498-5549-42b1-b2fe-23d365a05297 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] 10.222.0.64 "GET /compute/v2.1/servers/82a77751-75d6-4aa5-a0d6-cb1af296b4e7" status: 200 len: 1315 microversion: 2.1 time: 0.259083 Jul 19 15:45:52.802048 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 56/99] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:45:52 2022] GET /compute/v2.1/servers/82a77751-75d6-4aa5-a0d6-cb1af296b4e7 => generated 1315 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:45:52.925667 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-a852108c-5c50-4b28-b0f9-fdad1a208854 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:52.926427 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-a852108c-5c50-4b28-b0f9-fdad1a208854 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 4fa1efb1-1488-48f4-a6ec-9b4787e01277] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:52.934238 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-a852108c-5c50-4b28-b0f9-fdad1a208854 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:52.935667 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-a852108c-5c50-4b28-b0f9-fdad1a208854 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:52.954285 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-a852108c-5c50-4b28-b0f9-fdad1a208854 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:52.954902 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-a852108c-5c50-4b28-b0f9-fdad1a208854 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:52.986192 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-27349166-2727-474f-be00-f2a65837ffb7 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:52.991583 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-27349166-2727-474f-be00-f2a65837ffb7 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: 5f1579c0-907a-490f-ad8e-0fe2db0baf97] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:53.008197 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-27349166-2727-474f-be00-f2a65837ffb7 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:53.012526 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-27349166-2727-474f-be00-f2a65837ffb7 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:53.013443 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-27349166-2727-474f-be00-f2a65837ffb7 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:53.017137 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-27349166-2727-474f-be00-f2a65837ffb7 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:53.198278 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-a852108c-5c50-4b28-b0f9-fdad1a208854 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:53.208056 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-a852108c-5c50-4b28-b0f9-fdad1a208854 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277" status: 200 len: 1322 microversion: 2.1 time: 0.284870 Jul 19 15:45:53.208670 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 44/100] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:45:52 2022] GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277 => generated 1322 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:45:53.294674 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-27349166-2727-474f-be00-f2a65837ffb7 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7c42cf0bc84292bb0b7edb9f2e7fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a72d232f314a78b0e1c3f04b0ed682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:53.303267 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-27349166-2727-474f-be00-f2a65837ffb7 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/5f1579c0-907a-490f-ad8e-0fe2db0baf97" status: 200 len: 1366 microversion: 2.1 time: 0.323639 Jul 19 15:45:53.317056 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 57/101] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:45:52 2022] GET /compute/v2.1/servers/5f1579c0-907a-490f-ad8e-0fe2db0baf97 => generated 1366 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:45:53.596012 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-2ef28c5d-14ec-4845-8777-85632283dbdd tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:53.596931 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-2ef28c5d-14ec-4845-8777-85632283dbdd tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:53.606908 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-2ef28c5d-14ec-4845-8777-85632283dbdd tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:53.608438 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-2ef28c5d-14ec-4845-8777-85632283dbdd tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:53.620397 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-2ef28c5d-14ec-4845-8777-85632283dbdd tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:53.628836 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-2ef28c5d-14ec-4845-8777-85632283dbdd tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:53.808673 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-34a80bcb-5cf8-4da1-9d07-0e0161e18e80 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:53.809175 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-34a80bcb-5cf8-4da1-9d07-0e0161e18e80 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] [instance: 82a77751-75d6-4aa5-a0d6-cb1af296b4e7] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:53.819893 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-34a80bcb-5cf8-4da1-9d07-0e0161e18e80 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:53.820341 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-34a80bcb-5cf8-4da1-9d07-0e0161e18e80 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:53.821113 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-34a80bcb-5cf8-4da1-9d07-0e0161e18e80 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:53.821552 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-34a80bcb-5cf8-4da1-9d07-0e0161e18e80 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:54.147212 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-34a80bcb-5cf8-4da1-9d07-0e0161e18e80 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831d1557afd649518d34d4f970f96674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905aecc2e33f4befb1a47740e8d53611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:54.163953 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-34a80bcb-5cf8-4da1-9d07-0e0161e18e80 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] 10.222.0.64 "GET /compute/v2.1/servers/82a77751-75d6-4aa5-a0d6-cb1af296b4e7" status: 200 len: 1315 microversion: 2.1 time: 0.358147 Jul 19 15:45:54.166456 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 58/102] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:45:53 2022] GET /compute/v2.1/servers/82a77751-75d6-4aa5-a0d6-cb1af296b4e7 => generated 1315 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:45:54.224733 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-65485c07-c50a-472e-9a3a-1068889fff04 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:54.225407 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-65485c07-c50a-472e-9a3a-1068889fff04 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 4fa1efb1-1488-48f4-a6ec-9b4787e01277] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:54.239598 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-65485c07-c50a-472e-9a3a-1068889fff04 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:54.241808 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-65485c07-c50a-472e-9a3a-1068889fff04 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:54.244124 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-65485c07-c50a-472e-9a3a-1068889fff04 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:54.245218 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-65485c07-c50a-472e-9a3a-1068889fff04 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:54.265430 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-2ef28c5d-14ec-4845-8777-85632283dbdd tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:54.288606 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-2ef28c5d-14ec-4845-8777-85632283dbdd tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:54.293373 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-2ef28c5d-14ec-4845-8777-85632283dbdd tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:54.294830 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-2ef28c5d-14ec-4845-8777-85632283dbdd tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 200 len: 1406 microversion: 2.20 time: 0.703347 Jul 19 15:45:54.299487 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 45/103] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:45:53 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 1406 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:45:54.324682 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-1ffc3c20-b68f-428f-bfea-034503c2868e tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:54.325591 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-1ffc3c20-b68f-428f-bfea-034503c2868e tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: 5f1579c0-907a-490f-ad8e-0fe2db0baf97] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:54.333065 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-1ffc3c20-b68f-428f-bfea-034503c2868e tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:54.333788 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-1ffc3c20-b68f-428f-bfea-034503c2868e tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:54.334783 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-1ffc3c20-b68f-428f-bfea-034503c2868e tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:54.335408 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-1ffc3c20-b68f-428f-bfea-034503c2868e tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:54.580774 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-65485c07-c50a-472e-9a3a-1068889fff04 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:54.589673 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-65485c07-c50a-472e-9a3a-1068889fff04 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277" status: 200 len: 1322 microversion: 2.1 time: 0.368638 Jul 19 15:45:54.591834 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 59/104] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:45:54 2022] GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277 => generated 1322 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:45:54.787243 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-1ffc3c20-b68f-428f-bfea-034503c2868e tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7c42cf0bc84292bb0b7edb9f2e7fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a72d232f314a78b0e1c3f04b0ed682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:54.802759 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-1ffc3c20-b68f-428f-bfea-034503c2868e tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/5f1579c0-907a-490f-ad8e-0fe2db0baf97" status: 200 len: 1366 microversion: 2.1 time: 0.482025 Jul 19 15:45:54.803341 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 46/105] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:45:54 2022] GET /compute/v2.1/servers/5f1579c0-907a-490f-ad8e-0fe2db0baf97 => generated 1366 bytes in 483 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:45:55.182993 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-405a3ccd-2d54-43ae-abee-b6165995ac04 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:55.184302 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-405a3ccd-2d54-43ae-abee-b6165995ac04 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] [instance: 82a77751-75d6-4aa5-a0d6-cb1af296b4e7] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:55.195776 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-405a3ccd-2d54-43ae-abee-b6165995ac04 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:55.197381 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-405a3ccd-2d54-43ae-abee-b6165995ac04 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:55.201960 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-405a3ccd-2d54-43ae-abee-b6165995ac04 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:55.202840 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-405a3ccd-2d54-43ae-abee-b6165995ac04 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:55.313330 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-d242acd1-2ef9-455f-bbb9-97388d0c0d2d tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:55.314197 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-d242acd1-2ef9-455f-bbb9-97388d0c0d2d tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:55.330548 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-d242acd1-2ef9-455f-bbb9-97388d0c0d2d tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:55.331005 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-d242acd1-2ef9-455f-bbb9-97388d0c0d2d tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:55.331785 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-d242acd1-2ef9-455f-bbb9-97388d0c0d2d tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:55.332393 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-d242acd1-2ef9-455f-bbb9-97388d0c0d2d tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:55.378926 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG dbcounter [-] [129519] Writing DB stats nova_cell1:SELECT=100 {{(pid=129519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:55.607061 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-d242acd1-2ef9-455f-bbb9-97388d0c0d2d tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:55.618769 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-d242acd1-2ef9-455f-bbb9-97388d0c0d2d tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:55.629413 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-d242acd1-2ef9-455f-bbb9-97388d0c0d2d tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:55.634515 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-d242acd1-2ef9-455f-bbb9-97388d0c0d2d tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 200 len: 1406 microversion: 2.20 time: 0.322928 Jul 19 15:45:55.645610 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 47/106] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:45:55 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 1406 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 15:45:55.656065 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-591e714f-9e6a-4eaf-b80d-695c126fefcf tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:55.659573 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-591e714f-9e6a-4eaf-b80d-695c126fefcf tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 4fa1efb1-1488-48f4-a6ec-9b4787e01277] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:55.677629 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-591e714f-9e6a-4eaf-b80d-695c126fefcf tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:55.678974 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-591e714f-9e6a-4eaf-b80d-695c126fefcf tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:55.681610 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-591e714f-9e6a-4eaf-b80d-695c126fefcf tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:55.683507 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-591e714f-9e6a-4eaf-b80d-695c126fefcf tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:55.687254 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG dbcounter [-] [129519] Writing DB stats nova_cell0:SELECT=2 {{(pid=129519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:55.876521 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-405a3ccd-2d54-43ae-abee-b6165995ac04 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831d1557afd649518d34d4f970f96674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905aecc2e33f4befb1a47740e8d53611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:55.887765 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-405a3ccd-2d54-43ae-abee-b6165995ac04 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] 10.222.0.64 "GET /compute/v2.1/servers/82a77751-75d6-4aa5-a0d6-cb1af296b4e7" status: 200 len: 1315 microversion: 2.1 time: 0.709428 Jul 19 15:45:55.889577 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 60/107] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:45:55 2022] GET /compute/v2.1/servers/82a77751-75d6-4aa5-a0d6-cb1af296b4e7 => generated 1315 bytes in 712 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:45:55.898586 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-ff69691f-632b-4f44-a546-5f205ef934ba tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:55.899204 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-ff69691f-632b-4f44-a546-5f205ef934ba tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: 5f1579c0-907a-490f-ad8e-0fe2db0baf97] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:55.907207 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-ff69691f-632b-4f44-a546-5f205ef934ba tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:55.908122 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-ff69691f-632b-4f44-a546-5f205ef934ba tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:55.908966 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-ff69691f-632b-4f44-a546-5f205ef934ba tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:55.910416 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-ff69691f-632b-4f44-a546-5f205ef934ba tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:56.068389 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-ff69691f-632b-4f44-a546-5f205ef934ba tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7c42cf0bc84292bb0b7edb9f2e7fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a72d232f314a78b0e1c3f04b0ed682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:56.077704 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-ff69691f-632b-4f44-a546-5f205ef934ba tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/5f1579c0-907a-490f-ad8e-0fe2db0baf97" status: 200 len: 1366 microversion: 2.1 time: 0.186714 Jul 19 15:45:56.078485 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 61/108] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:45:55 2022] GET /compute/v2.1/servers/5f1579c0-907a-490f-ad8e-0fe2db0baf97 => generated 1366 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:45:56.125885 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-591e714f-9e6a-4eaf-b80d-695c126fefcf tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:56.136184 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-591e714f-9e6a-4eaf-b80d-695c126fefcf tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277" status: 200 len: 1322 microversion: 2.1 time: 0.498232 Jul 19 15:45:56.139836 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 48/109] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:45:55 2022] GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277 => generated 1322 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:45:56.655197 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-5dee8ad6-4c9d-4726-b8fc-9a0f75fa54f8 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:56.656493 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-5dee8ad6-4c9d-4726-b8fc-9a0f75fa54f8 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:56.663249 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-5dee8ad6-4c9d-4726-b8fc-9a0f75fa54f8 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:56.663874 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-5dee8ad6-4c9d-4726-b8fc-9a0f75fa54f8 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:56.664894 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-5dee8ad6-4c9d-4726-b8fc-9a0f75fa54f8 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:56.665424 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-5dee8ad6-4c9d-4726-b8fc-9a0f75fa54f8 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:56.908058 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-e53bec9d-a825-49ba-8f88-d24599459c25 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:56.908784 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-e53bec9d-a825-49ba-8f88-d24599459c25 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] [instance: 82a77751-75d6-4aa5-a0d6-cb1af296b4e7] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:56.922207 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-e53bec9d-a825-49ba-8f88-d24599459c25 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:56.923663 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-e53bec9d-a825-49ba-8f88-d24599459c25 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:56.926202 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-e53bec9d-a825-49ba-8f88-d24599459c25 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:56.927821 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-e53bec9d-a825-49ba-8f88-d24599459c25 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:56.938878 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-5dee8ad6-4c9d-4726-b8fc-9a0f75fa54f8 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:56.949491 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-5dee8ad6-4c9d-4726-b8fc-9a0f75fa54f8 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:56.951945 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-5dee8ad6-4c9d-4726-b8fc-9a0f75fa54f8 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:56.954402 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-5dee8ad6-4c9d-4726-b8fc-9a0f75fa54f8 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 200 len: 1406 microversion: 2.20 time: 0.303941 Jul 19 15:45:56.955297 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 62/110] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:45:56 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 1406 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:45:57.096144 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-b8098fd8-7428-4507-850c-04f9ea5dfc23 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:57.097189 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-b8098fd8-7428-4507-850c-04f9ea5dfc23 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: 5f1579c0-907a-490f-ad8e-0fe2db0baf97] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:57.109522 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b8098fd8-7428-4507-850c-04f9ea5dfc23 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:57.115106 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b8098fd8-7428-4507-850c-04f9ea5dfc23 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:57.116524 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b8098fd8-7428-4507-850c-04f9ea5dfc23 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:57.117142 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b8098fd8-7428-4507-850c-04f9ea5dfc23 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:57.235465 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-e53bec9d-a825-49ba-8f88-d24599459c25 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831d1557afd649518d34d4f970f96674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905aecc2e33f4befb1a47740e8d53611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:57.243173 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-e53bec9d-a825-49ba-8f88-d24599459c25 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] 10.222.0.64 "GET /compute/v2.1/servers/82a77751-75d6-4aa5-a0d6-cb1af296b4e7" status: 200 len: 1315 microversion: 2.1 time: 0.341673 Jul 19 15:45:57.255311 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 49/111] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:45:56 2022] GET /compute/v2.1/servers/82a77751-75d6-4aa5-a0d6-cb1af296b4e7 => generated 1315 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:45:57.267653 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-880096a9-5f9c-4e1c-9e43-47068d71fc76 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:57.269696 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-880096a9-5f9c-4e1c-9e43-47068d71fc76 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 4fa1efb1-1488-48f4-a6ec-9b4787e01277] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:57.286145 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-880096a9-5f9c-4e1c-9e43-47068d71fc76 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:57.286394 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-880096a9-5f9c-4e1c-9e43-47068d71fc76 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:57.287190 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-880096a9-5f9c-4e1c-9e43-47068d71fc76 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:57.287622 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-880096a9-5f9c-4e1c-9e43-47068d71fc76 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:57.378857 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-b8098fd8-7428-4507-850c-04f9ea5dfc23 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7c42cf0bc84292bb0b7edb9f2e7fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a72d232f314a78b0e1c3f04b0ed682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:57.390832 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-b8098fd8-7428-4507-850c-04f9ea5dfc23 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/5f1579c0-907a-490f-ad8e-0fe2db0baf97" status: 200 len: 1366 microversion: 2.1 time: 0.297007 Jul 19 15:45:57.401129 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 63/112] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:45:57 2022] GET /compute/v2.1/servers/5f1579c0-907a-490f-ad8e-0fe2db0baf97 => generated 1366 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:45:57.534690 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-880096a9-5f9c-4e1c-9e43-47068d71fc76 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:57.545766 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-880096a9-5f9c-4e1c-9e43-47068d71fc76 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277" status: 200 len: 1322 microversion: 2.1 time: 0.284168 Jul 19 15:45:57.547047 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 50/113] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:45:57 2022] GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277 => generated 1322 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:45:57.884885 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG dbcounter [-] [129520] Writing DB stats nova_cell0:SELECT=2 {{(pid=129520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:45:57.972967 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-308ec9c7-52f3-4cf3-9762-207a437943a0 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:57.974348 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-308ec9c7-52f3-4cf3-9762-207a437943a0 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:57.988715 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-308ec9c7-52f3-4cf3-9762-207a437943a0 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:57.989356 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-308ec9c7-52f3-4cf3-9762-207a437943a0 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:57.991996 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-308ec9c7-52f3-4cf3-9762-207a437943a0 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:57.992622 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-308ec9c7-52f3-4cf3-9762-207a437943a0 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:58.015643 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [req-18f2d848-0d7d-4098-acbf-2eecbc1157a6 req-a1f834d3-528b-42b1-8747-3481a206d851 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82a77751-75d6-4aa5-a0d6-cb1af296b4e7", "name": "network-vif-plugged", "status": "completed", "tag": "8cd72be0-aaa1-41b3-a6d5-52edc3f63b70"}]} {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:45:58.041699 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [req-18f2d848-0d7d-4098-acbf-2eecbc1157a6 req-a1f834d3-528b-42b1-8747-3481a206d851 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:58.041949 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [req-18f2d848-0d7d-4098-acbf-2eecbc1157a6 req-a1f834d3-528b-42b1-8747-3481a206d851 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:58.095153 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.compute.server_external_events [req-18f2d848-0d7d-4098-acbf-2eecbc1157a6 req-a1f834d3-528b-42b1-8747-3481a206d851 service nova] Creating event network-vif-plugged:8cd72be0-aaa1-41b3-a6d5-52edc3f63b70 for instance 82a77751-75d6-4aa5-a0d6-cb1af296b4e7 on hv-cinder-84902 Jul 19 15:45:58.104883 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [req-18f2d848-0d7d-4098-acbf-2eecbc1157a6 req-a1f834d3-528b-42b1-8747-3481a206d851 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.225853 Jul 19 15:45:58.105815 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 64/114] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Jul 19 15:45:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 15:45:58.261711 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-04492a9a-d5dc-4e2d-94e5-ef2b715d2541 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:58.263270 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-04492a9a-d5dc-4e2d-94e5-ef2b715d2541 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] [instance: 82a77751-75d6-4aa5-a0d6-cb1af296b4e7] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:58.273279 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-04492a9a-d5dc-4e2d-94e5-ef2b715d2541 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:58.275236 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-04492a9a-d5dc-4e2d-94e5-ef2b715d2541 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:58.280727 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-04492a9a-d5dc-4e2d-94e5-ef2b715d2541 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:58.282066 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-04492a9a-d5dc-4e2d-94e5-ef2b715d2541 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:58.339538 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-308ec9c7-52f3-4cf3-9762-207a437943a0 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:58.363678 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-308ec9c7-52f3-4cf3-9762-207a437943a0 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:58.368296 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-308ec9c7-52f3-4cf3-9762-207a437943a0 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:58.371807 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-308ec9c7-52f3-4cf3-9762-207a437943a0 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 200 len: 1406 microversion: 2.20 time: 0.402658 Jul 19 15:45:58.375619 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 51/115] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:45:57 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 1406 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:45:58.410974 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-a28cfb50-208b-4886-98b0-b5ab71ba78b5 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:58.411836 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-a28cfb50-208b-4886-98b0-b5ab71ba78b5 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: 5f1579c0-907a-490f-ad8e-0fe2db0baf97] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:58.420905 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-a28cfb50-208b-4886-98b0-b5ab71ba78b5 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:58.423795 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-a28cfb50-208b-4886-98b0-b5ab71ba78b5 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:58.425501 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-a28cfb50-208b-4886-98b0-b5ab71ba78b5 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:58.428594 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-a28cfb50-208b-4886-98b0-b5ab71ba78b5 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:58.750007 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-04492a9a-d5dc-4e2d-94e5-ef2b715d2541 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831d1557afd649518d34d4f970f96674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905aecc2e33f4befb1a47740e8d53611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:58.761742 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-04492a9a-d5dc-4e2d-94e5-ef2b715d2541 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] 10.222.0.64 "GET /compute/v2.1/servers/82a77751-75d6-4aa5-a0d6-cb1af296b4e7" status: 200 len: 1315 microversion: 2.1 time: 0.504660 Jul 19 15:45:58.763623 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 65/116] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:45:58 2022] GET /compute/v2.1/servers/82a77751-75d6-4aa5-a0d6-cb1af296b4e7 => generated 1315 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:45:58.772249 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-3493c45d-2679-4fe5-b649-f2c300946033 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:58.773069 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-3493c45d-2679-4fe5-b649-f2c300946033 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 4fa1efb1-1488-48f4-a6ec-9b4787e01277] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:58.781800 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-3493c45d-2679-4fe5-b649-f2c300946033 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:58.782100 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-3493c45d-2679-4fe5-b649-f2c300946033 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:58.783064 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-3493c45d-2679-4fe5-b649-f2c300946033 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:58.783672 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-3493c45d-2679-4fe5-b649-f2c300946033 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:58.923285 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-a28cfb50-208b-4886-98b0-b5ab71ba78b5 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7c42cf0bc84292bb0b7edb9f2e7fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a72d232f314a78b0e1c3f04b0ed682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:58.932664 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-a28cfb50-208b-4886-98b0-b5ab71ba78b5 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/5f1579c0-907a-490f-ad8e-0fe2db0baf97" status: 200 len: 1366 microversion: 2.1 time: 0.528123 Jul 19 15:45:58.938564 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 52/117] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:45:58 2022] GET /compute/v2.1/servers/5f1579c0-907a-490f-ad8e-0fe2db0baf97 => generated 1366 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:45:59.055389 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-3493c45d-2679-4fe5-b649-f2c300946033 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:59.064238 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-3493c45d-2679-4fe5-b649-f2c300946033 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277" status: 200 len: 1322 microversion: 2.1 time: 0.298739 Jul 19 15:45:59.064824 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 66/118] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:45:58 2022] GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277 => generated 1322 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:45:59.401819 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-61717b65-15a4-4bff-a765-129fa5a2f2c1 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:59.403221 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-61717b65-15a4-4bff-a765-129fa5a2f2c1 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:59.413327 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-61717b65-15a4-4bff-a765-129fa5a2f2c1 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:59.414115 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-61717b65-15a4-4bff-a765-129fa5a2f2c1 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:59.415219 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-61717b65-15a4-4bff-a765-129fa5a2f2c1 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:59.416040 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-61717b65-15a4-4bff-a765-129fa5a2f2c1 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:59.588545 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-61717b65-15a4-4bff-a765-129fa5a2f2c1 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:59.598493 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-61717b65-15a4-4bff-a765-129fa5a2f2c1 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:59.600647 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-61717b65-15a4-4bff-a765-129fa5a2f2c1 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:59.602844 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-61717b65-15a4-4bff-a765-129fa5a2f2c1 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 200 len: 1406 microversion: 2.20 time: 0.206883 Jul 19 15:45:59.614025 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 53/119] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:45:59 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 1406 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:45:59.779507 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-4627d60e-3d12-40ac-965c-416f3980cbca tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:59.780188 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-4627d60e-3d12-40ac-965c-416f3980cbca tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] [instance: 82a77751-75d6-4aa5-a0d6-cb1af296b4e7] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:59.786713 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-4627d60e-3d12-40ac-965c-416f3980cbca tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:59.787381 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-4627d60e-3d12-40ac-965c-416f3980cbca tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:59.788262 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-4627d60e-3d12-40ac-965c-416f3980cbca tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:59.788914 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-4627d60e-3d12-40ac-965c-416f3980cbca tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:59.941267 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-4627d60e-3d12-40ac-965c-416f3980cbca tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831d1557afd649518d34d4f970f96674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905aecc2e33f4befb1a47740e8d53611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:45:59.952295 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-4627d60e-3d12-40ac-965c-416f3980cbca tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] 10.222.0.64 "GET /compute/v2.1/servers/82a77751-75d6-4aa5-a0d6-cb1af296b4e7" status: 200 len: 1315 microversion: 2.1 time: 0.175987 Jul 19 15:45:59.953323 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-84c9d657-1683-4d14-9674-1618266b82e4 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:45:59.953932 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-84c9d657-1683-4d14-9674-1618266b82e4 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: 5f1579c0-907a-490f-ad8e-0fe2db0baf97] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:45:59.955822 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 67/120] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:45:59 2022] GET /compute/v2.1/servers/82a77751-75d6-4aa5-a0d6-cb1af296b4e7 => generated 1315 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:45:59.962013 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-84c9d657-1683-4d14-9674-1618266b82e4 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:59.962646 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-84c9d657-1683-4d14-9674-1618266b82e4 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:45:59.963573 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-84c9d657-1683-4d14-9674-1618266b82e4 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:45:59.964040 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-84c9d657-1683-4d14-9674-1618266b82e4 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:00.081600 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-930daf21-e2c2-4510-85bd-3274d74a0fe4 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:00.082280 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-930daf21-e2c2-4510-85bd-3274d74a0fe4 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 4fa1efb1-1488-48f4-a6ec-9b4787e01277] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:00.095647 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-930daf21-e2c2-4510-85bd-3274d74a0fe4 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:00.096199 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-930daf21-e2c2-4510-85bd-3274d74a0fe4 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:00.099415 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-930daf21-e2c2-4510-85bd-3274d74a0fe4 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:00.101794 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-930daf21-e2c2-4510-85bd-3274d74a0fe4 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:00.257367 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-84c9d657-1683-4d14-9674-1618266b82e4 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7c42cf0bc84292bb0b7edb9f2e7fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a72d232f314a78b0e1c3f04b0ed682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:46:00.269488 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-84c9d657-1683-4d14-9674-1618266b82e4 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/5f1579c0-907a-490f-ad8e-0fe2db0baf97" status: 200 len: 1366 microversion: 2.1 time: 0.322606 Jul 19 15:46:00.273110 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 54/121] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:45:59 2022] GET /compute/v2.1/servers/5f1579c0-907a-490f-ad8e-0fe2db0baf97 => generated 1366 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:46:00.279450 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [req-0d009697-321f-43ea-947d-27891912251b req-5b1d2de5-f7c5-417e-8418-aeefb0f17dce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "764ab5a7-4ebb-4d76-a34b-5f311883bcbe", "name": "network-vif-plugged", "status": "completed", "tag": "e7989e60-2708-4f38-9de4-2ddeed675e74"}, {"server_uuid": "3eeb4a51-a06c-4faf-9a63-bf3658ca773b", "name": "network-vif-plugged", "status": "completed", "tag": "61483d93-6fa5-46d1-b820-a274f98ffcbb"}, {"server_uuid": "5f1579c0-907a-490f-ad8e-0fe2db0baf97", "name": "network-vif-plugged", "status": "completed", "tag": "c75827cb-3014-46a1-a3d9-1c24d0e5f8f7"}, {"server_uuid": "4fa1efb1-1488-48f4-a6ec-9b4787e01277", "name": "network-vif-plugged", "status": "completed", "tag": "5e64b358-ca05-4217-81f6-26f217876ab3"}]} {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:46:00.296440 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [req-0d009697-321f-43ea-947d-27891912251b req-5b1d2de5-f7c5-417e-8418-aeefb0f17dce service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:00.297671 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [req-0d009697-321f-43ea-947d-27891912251b req-5b1d2de5-f7c5-417e-8418-aeefb0f17dce service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:00.321218 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.compute.server_external_events [req-0d009697-321f-43ea-947d-27891912251b req-5b1d2de5-f7c5-417e-8418-aeefb0f17dce service nova] Creating event network-vif-plugged:e7989e60-2708-4f38-9de4-2ddeed675e74 for instance 764ab5a7-4ebb-4d76-a34b-5f311883bcbe on hv-cinder-84902 Jul 19 15:46:00.321720 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.compute.server_external_events [req-0d009697-321f-43ea-947d-27891912251b req-5b1d2de5-f7c5-417e-8418-aeefb0f17dce service nova] Creating event network-vif-plugged:61483d93-6fa5-46d1-b820-a274f98ffcbb for instance 3eeb4a51-a06c-4faf-9a63-bf3658ca773b on hv-cinder-84902 Jul 19 15:46:00.322626 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.compute.server_external_events [req-0d009697-321f-43ea-947d-27891912251b req-5b1d2de5-f7c5-417e-8418-aeefb0f17dce service nova] Creating event network-vif-plugged:c75827cb-3014-46a1-a3d9-1c24d0e5f8f7 for instance 5f1579c0-907a-490f-ad8e-0fe2db0baf97 on hv-cinder-84902 Jul 19 15:46:00.323302 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.compute.server_external_events [req-0d009697-321f-43ea-947d-27891912251b req-5b1d2de5-f7c5-417e-8418-aeefb0f17dce service nova] Creating event network-vif-plugged:5e64b358-ca05-4217-81f6-26f217876ab3 for instance 4fa1efb1-1488-48f4-a6ec-9b4787e01277 on hv-cinder-84902 Jul 19 15:46:00.340356 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [req-0d009697-321f-43ea-947d-27891912251b req-5b1d2de5-f7c5-417e-8418-aeefb0f17dce service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 696 microversion: 2.1 time: 0.065728 Jul 19 15:46:00.346049 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 55/122] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Jul 19 15:46:00 2022] POST /compute/v2.1/os-server-external-events => generated 696 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:46:00.348317 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-930daf21-e2c2-4510-85bd-3274d74a0fe4 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:46:00.359396 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-930daf21-e2c2-4510-85bd-3274d74a0fe4 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277" status: 200 len: 1322 microversion: 2.1 time: 0.281870 Jul 19 15:46:00.360377 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 68/123] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:46:00 2022] GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277 => generated 1322 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:46:00.643788 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-2104a3e0-4cb0-4f74-bc96-ca64a5fddc88 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:00.653933 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-2104a3e0-4cb0-4f74-bc96-ca64a5fddc88 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:00.690891 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-2104a3e0-4cb0-4f74-bc96-ca64a5fddc88 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:00.691838 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-2104a3e0-4cb0-4f74-bc96-ca64a5fddc88 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:00.693484 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-2104a3e0-4cb0-4f74-bc96-ca64a5fddc88 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:00.696616 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-2104a3e0-4cb0-4f74-bc96-ca64a5fddc88 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:00.971539 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-0d7c2482-c1f3-405c-8284-cb6c184c579e tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:00.972481 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-0d7c2482-c1f3-405c-8284-cb6c184c579e tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] [instance: 82a77751-75d6-4aa5-a0d6-cb1af296b4e7] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:00.981057 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-0d7c2482-c1f3-405c-8284-cb6c184c579e tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:00.981799 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-0d7c2482-c1f3-405c-8284-cb6c184c579e tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:00.983601 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-0d7c2482-c1f3-405c-8284-cb6c184c579e tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:00.984278 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-0d7c2482-c1f3-405c-8284-cb6c184c579e tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:00.988597 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-2104a3e0-4cb0-4f74-bc96-ca64a5fddc88 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:46:01.003134 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-2104a3e0-4cb0-4f74-bc96-ca64a5fddc88 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:46:01.004589 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-2104a3e0-4cb0-4f74-bc96-ca64a5fddc88 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:46:01.005710 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-2104a3e0-4cb0-4f74-bc96-ca64a5fddc88 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 200 len: 1406 microversion: 2.20 time: 0.381041 Jul 19 15:46:01.006266 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 56/124] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:46:00 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 1406 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:46:01.020467 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG dbcounter [-] [129520] Writing DB stats nova_cell1:SELECT=100 {{(pid=129520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:46:01.292841 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-0504cfdd-e3b3-497b-88b5-412950280cc0 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:01.293537 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-0504cfdd-e3b3-497b-88b5-412950280cc0 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: 5f1579c0-907a-490f-ad8e-0fe2db0baf97] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:01.301899 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-0504cfdd-e3b3-497b-88b5-412950280cc0 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:01.308959 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-0504cfdd-e3b3-497b-88b5-412950280cc0 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:01.311942 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-0504cfdd-e3b3-497b-88b5-412950280cc0 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:01.314964 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-0504cfdd-e3b3-497b-88b5-412950280cc0 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:01.642848 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-0d7c2482-c1f3-405c-8284-cb6c184c579e tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831d1557afd649518d34d4f970f96674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905aecc2e33f4befb1a47740e8d53611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:46:01.651325 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-0d7c2482-c1f3-405c-8284-cb6c184c579e tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] 10.222.0.64 "GET /compute/v2.1/servers/82a77751-75d6-4aa5-a0d6-cb1af296b4e7" status: 200 len: 1501 microversion: 2.1 time: 0.685127 Jul 19 15:46:01.651908 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 69/125] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:46:00 2022] GET /compute/v2.1/servers/82a77751-75d6-4aa5-a0d6-cb1af296b4e7 => generated 1501 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:46:01.658980 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-7dd22ce5-11d3-415b-ac50-d51c261ee95b tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:01.659583 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-7dd22ce5-11d3-415b-ac50-d51c261ee95b tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 4fa1efb1-1488-48f4-a6ec-9b4787e01277] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:01.679524 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-7dd22ce5-11d3-415b-ac50-d51c261ee95b tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:01.680223 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-7dd22ce5-11d3-415b-ac50-d51c261ee95b tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:01.681162 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-7dd22ce5-11d3-415b-ac50-d51c261ee95b tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:01.688221 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-7dd22ce5-11d3-415b-ac50-d51c261ee95b tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:01.853175 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-0504cfdd-e3b3-497b-88b5-412950280cc0 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7c42cf0bc84292bb0b7edb9f2e7fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a72d232f314a78b0e1c3f04b0ed682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:46:01.864172 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-0504cfdd-e3b3-497b-88b5-412950280cc0 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/5f1579c0-907a-490f-ad8e-0fe2db0baf97" status: 200 len: 1366 microversion: 2.1 time: 0.577368 Jul 19 15:46:01.864759 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 57/126] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:46:01 2022] GET /compute/v2.1/servers/5f1579c0-907a-490f-ad8e-0fe2db0baf97 => generated 1366 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:46:01.929527 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-7dd22ce5-11d3-415b-ac50-d51c261ee95b tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:46:01.941809 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-7dd22ce5-11d3-415b-ac50-d51c261ee95b tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277" status: 200 len: 1322 microversion: 2.1 time: 0.285545 Jul 19 15:46:01.946351 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 70/127] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:46:01 2022] GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277 => generated 1322 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:46:02.025322 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-12894b05-f5d2-4c76-8668-6b1525060223 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:02.025901 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-12894b05-f5d2-4c76-8668-6b1525060223 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:02.036580 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-12894b05-f5d2-4c76-8668-6b1525060223 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:02.036580 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-12894b05-f5d2-4c76-8668-6b1525060223 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:02.037619 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-12894b05-f5d2-4c76-8668-6b1525060223 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:02.038266 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-12894b05-f5d2-4c76-8668-6b1525060223 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:02.260542 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-12894b05-f5d2-4c76-8668-6b1525060223 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:46:02.274798 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-12894b05-f5d2-4c76-8668-6b1525060223 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:46:02.281513 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-12894b05-f5d2-4c76-8668-6b1525060223 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:46:02.283186 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-12894b05-f5d2-4c76-8668-6b1525060223 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 200 len: 1406 microversion: 2.20 time: 0.262040 Jul 19 15:46:02.283896 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 58/128] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:46:02 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 1406 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:46:02.890780 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-62735889-870b-4b26-9516-489b81d16718 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:02.891467 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-62735889-870b-4b26-9516-489b81d16718 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: 5f1579c0-907a-490f-ad8e-0fe2db0baf97] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:02.901027 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-62735889-870b-4b26-9516-489b81d16718 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:02.901598 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-62735889-870b-4b26-9516-489b81d16718 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:02.902641 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-62735889-870b-4b26-9516-489b81d16718 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:02.903453 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-62735889-870b-4b26-9516-489b81d16718 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:02.966402 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-c51d9688-68a9-4a0d-bafe-ee25e4bce8c8 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:02.967487 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-c51d9688-68a9-4a0d-bafe-ee25e4bce8c8 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 4fa1efb1-1488-48f4-a6ec-9b4787e01277] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:02.974745 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG dbcounter [-] [129519] Writing DB stats nova_api:SELECT=76 {{(pid=129519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:46:02.976943 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-c51d9688-68a9-4a0d-bafe-ee25e4bce8c8 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:02.977958 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-c51d9688-68a9-4a0d-bafe-ee25e4bce8c8 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:02.979587 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-c51d9688-68a9-4a0d-bafe-ee25e4bce8c8 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:02.980625 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-c51d9688-68a9-4a0d-bafe-ee25e4bce8c8 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:03.084335 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-62735889-870b-4b26-9516-489b81d16718 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7c42cf0bc84292bb0b7edb9f2e7fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a72d232f314a78b0e1c3f04b0ed682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:46:03.093385 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-62735889-870b-4b26-9516-489b81d16718 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/5f1579c0-907a-490f-ad8e-0fe2db0baf97" status: 200 len: 1366 microversion: 2.1 time: 0.208088 Jul 19 15:46:03.095004 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 71/129] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:46:02 2022] GET /compute/v2.1/servers/5f1579c0-907a-490f-ad8e-0fe2db0baf97 => generated 1366 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:46:03.149602 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-c51d9688-68a9-4a0d-bafe-ee25e4bce8c8 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:46:03.158703 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-c51d9688-68a9-4a0d-bafe-ee25e4bce8c8 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277" status: 200 len: 1322 microversion: 2.1 time: 0.201410 Jul 19 15:46:03.159453 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 59/130] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:46:02 2022] GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277 => generated 1322 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:46:03.301891 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-fa422954-b750-4861-b7a5-ba3504252e0f tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:03.302527 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-fa422954-b750-4861-b7a5-ba3504252e0f tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:03.309810 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-fa422954-b750-4861-b7a5-ba3504252e0f tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:03.314267 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-fa422954-b750-4861-b7a5-ba3504252e0f tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:03.315161 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-fa422954-b750-4861-b7a5-ba3504252e0f tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:03.315725 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-fa422954-b750-4861-b7a5-ba3504252e0f tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:03.346193 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-0bee128f-83ad-4a25-8c6d-d61fff16589c tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "53f76d41-006d-44ea-95af-334d2204bb09"}} {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:46:03.347826 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-0bee128f-83ad-4a25-8c6d-d61fff16589c tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] [instance: 82a77751-75d6-4aa5-a0d6-cb1af296b4e7] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:03.353935 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-0bee128f-83ad-4a25-8c6d-d61fff16589c tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:03.354595 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-0bee128f-83ad-4a25-8c6d-d61fff16589c tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:03.355441 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-0bee128f-83ad-4a25-8c6d-d61fff16589c tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:03.355934 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-0bee128f-83ad-4a25-8c6d-d61fff16589c tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:03.488162 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-fa422954-b750-4861-b7a5-ba3504252e0f tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:46:03.502575 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-fa422954-b750-4861-b7a5-ba3504252e0f tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:46:03.502681 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-fa422954-b750-4861-b7a5-ba3504252e0f tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:46:03.503772 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-fa422954-b750-4861-b7a5-ba3504252e0f tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 200 len: 1406 microversion: 2.20 time: 0.206055 Jul 19 15:46:03.514386 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 72/131] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:46:03 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 1406 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:46:04.112029 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-0efeae75-90b7-4735-a11e-880524524652 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:04.112673 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-0efeae75-90b7-4735-a11e-880524524652 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: 5f1579c0-907a-490f-ad8e-0fe2db0baf97] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:04.118885 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-0efeae75-90b7-4735-a11e-880524524652 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:04.119329 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-0efeae75-90b7-4735-a11e-880524524652 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:04.120079 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-0efeae75-90b7-4735-a11e-880524524652 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:04.120620 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-0efeae75-90b7-4735-a11e-880524524652 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:04.257467 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-0efeae75-90b7-4735-a11e-880524524652 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7c42cf0bc84292bb0b7edb9f2e7fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a72d232f314a78b0e1c3f04b0ed682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:46:04.264948 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-0efeae75-90b7-4735-a11e-880524524652 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/5f1579c0-907a-490f-ad8e-0fe2db0baf97" status: 200 len: 1366 microversion: 2.1 time: 0.157841 Jul 19 15:46:04.265509 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 73/132] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:46:04 2022] GET /compute/v2.1/servers/5f1579c0-907a-490f-ad8e-0fe2db0baf97 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:46:04.269773 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-91df6d89-d4c7-482b-a904-2141b2991abd tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:04.270380 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-91df6d89-d4c7-482b-a904-2141b2991abd tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 4fa1efb1-1488-48f4-a6ec-9b4787e01277] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:04.275850 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-91df6d89-d4c7-482b-a904-2141b2991abd tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:04.276286 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-91df6d89-d4c7-482b-a904-2141b2991abd tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:04.277022 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-91df6d89-d4c7-482b-a904-2141b2991abd tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:04.277440 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-91df6d89-d4c7-482b-a904-2141b2991abd tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:04.404877 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-91df6d89-d4c7-482b-a904-2141b2991abd tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:46:04.412427 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-91df6d89-d4c7-482b-a904-2141b2991abd tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277" status: 200 len: 1322 microversion: 2.1 time: 0.145998 Jul 19 15:46:04.412984 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 74/133] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:46:04 2022] GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277 => generated 1322 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:46:04.521250 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-82734fa8-6d23-4558-8424-13468b05e2b8 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:04.521856 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-82734fa8-6d23-4558-8424-13468b05e2b8 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:04.527988 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-82734fa8-6d23-4558-8424-13468b05e2b8 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:04.528432 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-82734fa8-6d23-4558-8424-13468b05e2b8 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:04.529186 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-82734fa8-6d23-4558-8424-13468b05e2b8 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:04.529844 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-82734fa8-6d23-4558-8424-13468b05e2b8 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:04.658614 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-82734fa8-6d23-4558-8424-13468b05e2b8 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:46:04.666751 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-82734fa8-6d23-4558-8424-13468b05e2b8 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:46:04.668269 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-82734fa8-6d23-4558-8424-13468b05e2b8 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:46:04.669363 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-82734fa8-6d23-4558-8424-13468b05e2b8 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 200 len: 1406 microversion: 2.20 time: 0.152032 Jul 19 15:46:04.669957 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 75/134] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:46:04 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 1406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 15:46:05.281629 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-b1e14760-8579-4e5d-a250-f482f565479a tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:05.282236 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-b1e14760-8579-4e5d-a250-f482f565479a tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: 5f1579c0-907a-490f-ad8e-0fe2db0baf97] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:05.288528 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b1e14760-8579-4e5d-a250-f482f565479a tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:05.288973 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b1e14760-8579-4e5d-a250-f482f565479a tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:05.289723 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b1e14760-8579-4e5d-a250-f482f565479a tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:05.290156 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b1e14760-8579-4e5d-a250-f482f565479a tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:05.427146 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-b1e14760-8579-4e5d-a250-f482f565479a tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7c42cf0bc84292bb0b7edb9f2e7fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a72d232f314a78b0e1c3f04b0ed682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:46:05.434574 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-b1e14760-8579-4e5d-a250-f482f565479a tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/5f1579c0-907a-490f-ad8e-0fe2db0baf97" status: 200 len: 1366 microversion: 2.1 time: 0.156737 Jul 19 15:46:05.435133 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 76/135] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:46:05 2022] GET /compute/v2.1/servers/5f1579c0-907a-490f-ad8e-0fe2db0baf97 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:46:05.440190 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-3a912099-c59e-4edf-a7d6-162eba7708a7 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:05.440775 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-3a912099-c59e-4edf-a7d6-162eba7708a7 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 4fa1efb1-1488-48f4-a6ec-9b4787e01277] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:05.446618 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-3a912099-c59e-4edf-a7d6-162eba7708a7 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:05.447059 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-3a912099-c59e-4edf-a7d6-162eba7708a7 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:05.447797 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-3a912099-c59e-4edf-a7d6-162eba7708a7 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:05.448216 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-3a912099-c59e-4edf-a7d6-162eba7708a7 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:05.578582 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-3a912099-c59e-4edf-a7d6-162eba7708a7 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:46:05.585947 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-3a912099-c59e-4edf-a7d6-162eba7708a7 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277" status: 200 len: 1322 microversion: 2.1 time: 0.149217 Jul 19 15:46:05.586548 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 77/136] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:46:05 2022] GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277 => generated 1322 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:46:05.687757 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-7fdf446e-e7af-44bf-99ff-dc56fb01a8a9 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:05.688343 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-7fdf446e-e7af-44bf-99ff-dc56fb01a8a9 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:05.694428 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-7fdf446e-e7af-44bf-99ff-dc56fb01a8a9 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:05.694869 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-7fdf446e-e7af-44bf-99ff-dc56fb01a8a9 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:05.695610 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-7fdf446e-e7af-44bf-99ff-dc56fb01a8a9 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:05.696033 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-7fdf446e-e7af-44bf-99ff-dc56fb01a8a9 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:05.823266 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-7fdf446e-e7af-44bf-99ff-dc56fb01a8a9 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:46:05.831673 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-7fdf446e-e7af-44bf-99ff-dc56fb01a8a9 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:46:05.833156 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-7fdf446e-e7af-44bf-99ff-dc56fb01a8a9 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:46:05.834228 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-7fdf446e-e7af-44bf-99ff-dc56fb01a8a9 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 200 len: 1406 microversion: 2.20 time: 0.151023 Jul 19 15:46:05.834811 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 78/137] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:46:05 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 1406 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 15:46:06.452663 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-b642f571-a470-47bb-9685-4cf0945a5e5f tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:06.453324 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-b642f571-a470-47bb-9685-4cf0945a5e5f tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: 5f1579c0-907a-490f-ad8e-0fe2db0baf97] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:06.459253 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b642f571-a470-47bb-9685-4cf0945a5e5f tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:06.459698 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b642f571-a470-47bb-9685-4cf0945a5e5f tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:06.460447 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b642f571-a470-47bb-9685-4cf0945a5e5f tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:06.460882 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b642f571-a470-47bb-9685-4cf0945a5e5f tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:06.591857 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-b642f571-a470-47bb-9685-4cf0945a5e5f tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7c42cf0bc84292bb0b7edb9f2e7fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a72d232f314a78b0e1c3f04b0ed682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:46:06.599645 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-b642f571-a470-47bb-9685-4cf0945a5e5f tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/5f1579c0-907a-490f-ad8e-0fe2db0baf97" status: 200 len: 1366 microversion: 2.1 time: 0.151242 Jul 19 15:46:06.600369 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 79/138] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:46:06 2022] GET /compute/v2.1/servers/5f1579c0-907a-490f-ad8e-0fe2db0baf97 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:46:06.604930 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-c0fcefdc-37be-4d98-9447-c26b79d8cc3a tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:06.605611 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-c0fcefdc-37be-4d98-9447-c26b79d8cc3a tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 4fa1efb1-1488-48f4-a6ec-9b4787e01277] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:06.612595 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-c0fcefdc-37be-4d98-9447-c26b79d8cc3a tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:06.613024 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-c0fcefdc-37be-4d98-9447-c26b79d8cc3a tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:06.613775 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-c0fcefdc-37be-4d98-9447-c26b79d8cc3a tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:06.614205 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-c0fcefdc-37be-4d98-9447-c26b79d8cc3a tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:06.754726 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-c0fcefdc-37be-4d98-9447-c26b79d8cc3a tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:46:06.762160 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-c0fcefdc-37be-4d98-9447-c26b79d8cc3a tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277" status: 200 len: 1322 microversion: 2.1 time: 0.160839 Jul 19 15:46:06.762754 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 80/139] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:46:06 2022] GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277 => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:46:06.852489 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-48d27ac3-0d9c-4ae8-b152-e60b00e1f2f1 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:06.853089 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-48d27ac3-0d9c-4ae8-b152-e60b00e1f2f1 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:06.862305 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-48d27ac3-0d9c-4ae8-b152-e60b00e1f2f1 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:06.862776 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-48d27ac3-0d9c-4ae8-b152-e60b00e1f2f1 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:06.863552 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-48d27ac3-0d9c-4ae8-b152-e60b00e1f2f1 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:06.863989 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-48d27ac3-0d9c-4ae8-b152-e60b00e1f2f1 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:07.012557 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-48d27ac3-0d9c-4ae8-b152-e60b00e1f2f1 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:46:07.021291 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-48d27ac3-0d9c-4ae8-b152-e60b00e1f2f1 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:46:07.022956 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-48d27ac3-0d9c-4ae8-b152-e60b00e1f2f1 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:46:07.024228 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-48d27ac3-0d9c-4ae8-b152-e60b00e1f2f1 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 200 len: 1599 microversion: 2.20 time: 0.175688 Jul 19 15:46:07.024781 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 81/140] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:46:06 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 1599 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 15:46:07.042804 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-d0c6f232-f901-4f81-9d79-2538a89f7d59 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:07.043324 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-d0c6f232-f901-4f81-9d79-2538a89f7d59 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:07.049744 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-d0c6f232-f901-4f81-9d79-2538a89f7d59 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:07.050239 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-d0c6f232-f901-4f81-9d79-2538a89f7d59 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:07.051025 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-d0c6f232-f901-4f81-9d79-2538a89f7d59 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:07.051451 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-d0c6f232-f901-4f81-9d79-2538a89f7d59 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:07.173013 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-d0c6f232-f901-4f81-9d79-2538a89f7d59 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.133844 Jul 19 15:46:07.173611 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 82/141] 10.222.0.64 () {60 vars in 1315 bytes} [Tue Jul 19 15:46:07 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b/os-interface => generated 285 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 19 15:46:07.621094 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-fd47b9a5-6e5b-4b4a-9630-48e201552653 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:07.624115 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-fd47b9a5-6e5b-4b4a-9630-48e201552653 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: 5f1579c0-907a-490f-ad8e-0fe2db0baf97] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:07.633953 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG dbcounter [-] [129520] Writing DB stats nova_api:SELECT=93 {{(pid=129520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:46:07.636164 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-fd47b9a5-6e5b-4b4a-9630-48e201552653 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:07.636829 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-fd47b9a5-6e5b-4b4a-9630-48e201552653 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:07.648283 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-fd47b9a5-6e5b-4b4a-9630-48e201552653 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:07.649095 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-fd47b9a5-6e5b-4b4a-9630-48e201552653 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:07.956045 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-fd47b9a5-6e5b-4b4a-9630-48e201552653 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7c42cf0bc84292bb0b7edb9f2e7fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a72d232f314a78b0e1c3f04b0ed682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:46:07.964696 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-fd47b9a5-6e5b-4b4a-9630-48e201552653 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/5f1579c0-907a-490f-ad8e-0fe2db0baf97" status: 200 len: 1366 microversion: 2.1 time: 0.350254 Jul 19 15:46:07.965939 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 83/142] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:46:07 2022] GET /compute/v2.1/servers/5f1579c0-907a-490f-ad8e-0fe2db0baf97 => generated 1366 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:46:07.978210 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-87b87c26-7b93-4c88-a71b-07ce5f6cf2ff tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:07.979127 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-87b87c26-7b93-4c88-a71b-07ce5f6cf2ff tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 4fa1efb1-1488-48f4-a6ec-9b4787e01277] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:07.987058 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-87b87c26-7b93-4c88-a71b-07ce5f6cf2ff tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:07.987728 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-87b87c26-7b93-4c88-a71b-07ce5f6cf2ff tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:07.988816 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-87b87c26-7b93-4c88-a71b-07ce5f6cf2ff tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:07.989562 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-87b87c26-7b93-4c88-a71b-07ce5f6cf2ff tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:08.137347 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-87b87c26-7b93-4c88-a71b-07ce5f6cf2ff tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:46:08.145702 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-87b87c26-7b93-4c88-a71b-07ce5f6cf2ff tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277" status: 200 len: 1515 microversion: 2.1 time: 0.173018 Jul 19 15:46:08.146268 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 84/143] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:46:07 2022] GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277 => generated 1515 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:46:08.164197 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-c930e13a-130e-4e2d-b288-6c759b2adbb1 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:46:08.165203 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-c930e13a-130e-4e2d-b288-6c759b2adbb1 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 4fa1efb1-1488-48f4-a6ec-9b4787e01277] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:08.171577 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-c930e13a-130e-4e2d-b288-6c759b2adbb1 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:08.172026 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-c930e13a-130e-4e2d-b288-6c759b2adbb1 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:08.172787 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-c930e13a-130e-4e2d-b288-6c759b2adbb1 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:08.173222 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-c930e13a-130e-4e2d-b288-6c759b2adbb1 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:08.195308 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.objects.instance [None req-c930e13a-130e-4e2d-b288-6c759b2adbb1 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lazy-loading 'flavor' on Instance uuid 4fa1efb1-1488-48f4-a6ec-9b4787e01277 {{(pid=129520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 15:46:08.260513 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG dbcounter [-] [129520] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=129520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:46:08.317419 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-c930e13a-130e-4e2d-b288-6c759b2adbb1 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "POST /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277/action" status: 200 len: 32 microversion: 2.1 time: 0.157248 Jul 19 15:46:08.318047 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 85/144] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Jul 19 15:46:08 2022] POST /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277/action => generated 32 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 19 15:46:08.327897 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-c1364109-2203-4a9f-974b-46193015bada tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:08.328581 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-c1364109-2203-4a9f-974b-46193015bada tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 4fa1efb1-1488-48f4-a6ec-9b4787e01277] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:08.334814 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-c1364109-2203-4a9f-974b-46193015bada tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:08.335258 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-c1364109-2203-4a9f-974b-46193015bada tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:08.336006 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-c1364109-2203-4a9f-974b-46193015bada tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:08.336439 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-c1364109-2203-4a9f-974b-46193015bada tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:08.472754 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-c1364109-2203-4a9f-974b-46193015bada tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:46:08.480600 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-c1364109-2203-4a9f-974b-46193015bada tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277" status: 200 len: 1521 microversion: 2.1 time: 0.157442 Jul 19 15:46:08.481233 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 86/145] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:46:08 2022] GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277 => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:46:08.667129 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [req-d0bd5dc5-8d3d-4c73-bf78-08809b528ee8 req-654cf14b-95ab-4a07-b908-15c92964089e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3eeb4a51-a06c-4faf-9a63-bf3658ca773b", "tag": "61483d93-6fa5-46d1-b820-a274f98ffcbb"}]} {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:46:08.675794 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [req-d0bd5dc5-8d3d-4c73-bf78-08809b528ee8 req-654cf14b-95ab-4a07-b908-15c92964089e service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:08.676223 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [req-d0bd5dc5-8d3d-4c73-bf78-08809b528ee8 req-654cf14b-95ab-4a07-b908-15c92964089e service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:08.689203 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.compute.server_external_events [req-d0bd5dc5-8d3d-4c73-bf78-08809b528ee8 req-654cf14b-95ab-4a07-b908-15c92964089e service nova] Creating event network-changed:61483d93-6fa5-46d1-b820-a274f98ffcbb for instance 3eeb4a51-a06c-4faf-9a63-bf3658ca773b on hv-cinder-84902 Jul 19 15:46:08.694125 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [req-d0bd5dc5-8d3d-4c73-bf78-08809b528ee8 req-654cf14b-95ab-4a07-b908-15c92964089e service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030703 Jul 19 15:46:08.694759 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 87/146] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Jul 19 15:46:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:46:08.982763 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-0a95d6b4-6839-4eab-8ec4-2c850fb7af0a tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:08.983452 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-0a95d6b4-6839-4eab-8ec4-2c850fb7af0a tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: 5f1579c0-907a-490f-ad8e-0fe2db0baf97] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:08.990172 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-0a95d6b4-6839-4eab-8ec4-2c850fb7af0a tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:08.990650 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-0a95d6b4-6839-4eab-8ec4-2c850fb7af0a tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:08.991413 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-0a95d6b4-6839-4eab-8ec4-2c850fb7af0a tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:08.991874 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-0a95d6b4-6839-4eab-8ec4-2c850fb7af0a tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:09.132719 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-0a95d6b4-6839-4eab-8ec4-2c850fb7af0a tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7c42cf0bc84292bb0b7edb9f2e7fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a72d232f314a78b0e1c3f04b0ed682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:46:09.140617 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-0a95d6b4-6839-4eab-8ec4-2c850fb7af0a tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/5f1579c0-907a-490f-ad8e-0fe2db0baf97" status: 200 len: 1366 microversion: 2.1 time: 0.162206 Jul 19 15:46:09.141276 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 88/147] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:46:08 2022] GET /compute/v2.1/servers/5f1579c0-907a-490f-ad8e-0fe2db0baf97 => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:46:09.496979 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-03458627-58d8-4f92-9f52-8abd173970e0 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:09.497583 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-03458627-58d8-4f92-9f52-8abd173970e0 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 4fa1efb1-1488-48f4-a6ec-9b4787e01277] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:09.503984 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-03458627-58d8-4f92-9f52-8abd173970e0 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:09.504438 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-03458627-58d8-4f92-9f52-8abd173970e0 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:09.505211 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-03458627-58d8-4f92-9f52-8abd173970e0 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:09.505649 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-03458627-58d8-4f92-9f52-8abd173970e0 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:09.644568 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-03458627-58d8-4f92-9f52-8abd173970e0 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:46:09.652039 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-03458627-58d8-4f92-9f52-8abd173970e0 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277" status: 200 len: 1521 microversion: 2.1 time: 0.158831 Jul 19 15:46:09.652539 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 89/148] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:46:09 2022] GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:46:10.156921 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-4dc380a4-55d1-43df-b213-8ca67d1d1b8a tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:10.157522 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-4dc380a4-55d1-43df-b213-8ca67d1d1b8a tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: 5f1579c0-907a-490f-ad8e-0fe2db0baf97] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:10.163820 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-4dc380a4-55d1-43df-b213-8ca67d1d1b8a tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:10.164267 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-4dc380a4-55d1-43df-b213-8ca67d1d1b8a tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:10.165020 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-4dc380a4-55d1-43df-b213-8ca67d1d1b8a tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:10.165452 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-4dc380a4-55d1-43df-b213-8ca67d1d1b8a tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:10.294177 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-4dc380a4-55d1-43df-b213-8ca67d1d1b8a tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7c42cf0bc84292bb0b7edb9f2e7fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a72d232f314a78b0e1c3f04b0ed682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:46:10.302152 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-4dc380a4-55d1-43df-b213-8ca67d1d1b8a tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/5f1579c0-907a-490f-ad8e-0fe2db0baf97" status: 200 len: 1366 microversion: 2.1 time: 0.149043 Jul 19 15:46:10.302747 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 90/149] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:46:10 2022] GET /compute/v2.1/servers/5f1579c0-907a-490f-ad8e-0fe2db0baf97 => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:46:10.669273 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-4698752f-6490-4393-88b5-37167178a452 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:10.669884 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-4698752f-6490-4393-88b5-37167178a452 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 4fa1efb1-1488-48f4-a6ec-9b4787e01277] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:10.676700 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-4698752f-6490-4393-88b5-37167178a452 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:10.677149 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-4698752f-6490-4393-88b5-37167178a452 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:10.677965 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-4698752f-6490-4393-88b5-37167178a452 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:10.678474 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-4698752f-6490-4393-88b5-37167178a452 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:10.808775 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-4698752f-6490-4393-88b5-37167178a452 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:46:10.816328 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-4698752f-6490-4393-88b5-37167178a452 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277" status: 200 len: 1521 microversion: 2.1 time: 0.150944 Jul 19 15:46:10.816898 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 91/150] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:46:10 2022] GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277 => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:46:11.136534 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-0bee128f-83ad-4a25-8c6d-d61fff16589c tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] 10.222.0.64 "POST /compute/v2.1/servers/82a77751-75d6-4aa5-a0d6-cb1af296b4e7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 7.795038 Jul 19 15:46:11.137968 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 60/151] 10.222.0.64 () {60 vars in 1322 bytes} [Tue Jul 19 15:46:03 2022] POST /compute/v2.1/servers/82a77751-75d6-4aa5-a0d6-cb1af296b4e7/os-volume_attachments => generated 194 bytes in 7797 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:46:11.320430 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-bfd17728-9926-470f-9661-6343a215a39a tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:11.321695 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-bfd17728-9926-470f-9661-6343a215a39a tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: 5f1579c0-907a-490f-ad8e-0fe2db0baf97] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:11.328557 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-bfd17728-9926-470f-9661-6343a215a39a tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:11.329262 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-bfd17728-9926-470f-9661-6343a215a39a tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:11.329901 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-bfd17728-9926-470f-9661-6343a215a39a tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:11.330552 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-bfd17728-9926-470f-9661-6343a215a39a tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:11.474036 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-bfd17728-9926-470f-9661-6343a215a39a tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7c42cf0bc84292bb0b7edb9f2e7fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a72d232f314a78b0e1c3f04b0ed682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:46:11.481371 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-bfd17728-9926-470f-9661-6343a215a39a tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/5f1579c0-907a-490f-ad8e-0fe2db0baf97" status: 200 len: 1366 microversion: 2.1 time: 0.165204 Jul 19 15:46:11.481937 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 92/152] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:46:11 2022] GET /compute/v2.1/servers/5f1579c0-907a-490f-ad8e-0fe2db0baf97 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:46:11.834709 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-4122fbea-cbf9-4c59-a4b6-79ae94471410 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:11.835405 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-4122fbea-cbf9-4c59-a4b6-79ae94471410 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 4fa1efb1-1488-48f4-a6ec-9b4787e01277] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:11.850134 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-4122fbea-cbf9-4c59-a4b6-79ae94471410 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:11.851051 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-4122fbea-cbf9-4c59-a4b6-79ae94471410 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:11.853025 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-4122fbea-cbf9-4c59-a4b6-79ae94471410 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:11.853899 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-4122fbea-cbf9-4c59-a4b6-79ae94471410 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:12.016432 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-4122fbea-cbf9-4c59-a4b6-79ae94471410 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:46:12.032004 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-4122fbea-cbf9-4c59-a4b6-79ae94471410 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277" status: 200 len: 1521 microversion: 2.1 time: 0.200051 Jul 19 15:46:12.034271 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 61/153] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:46:11 2022] GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277 => generated 1521 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:46:12.503763 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-14c0205a-16be-46a2-afdf-0acb9ad35f9e tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:12.504911 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-14c0205a-16be-46a2-afdf-0acb9ad35f9e tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: 5f1579c0-907a-490f-ad8e-0fe2db0baf97] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:12.526646 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-14c0205a-16be-46a2-afdf-0acb9ad35f9e tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:12.527462 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-14c0205a-16be-46a2-afdf-0acb9ad35f9e tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:12.528858 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-14c0205a-16be-46a2-afdf-0acb9ad35f9e tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:12.529647 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-14c0205a-16be-46a2-afdf-0acb9ad35f9e tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:12.830918 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-14c0205a-16be-46a2-afdf-0acb9ad35f9e tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7c42cf0bc84292bb0b7edb9f2e7fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a72d232f314a78b0e1c3f04b0ed682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:46:12.841984 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-14c0205a-16be-46a2-afdf-0acb9ad35f9e tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/5f1579c0-907a-490f-ad8e-0fe2db0baf97" status: 200 len: 1556 microversion: 2.1 time: 0.346080 Jul 19 15:46:12.843215 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 93/154] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:46:12 2022] GET /compute/v2.1/servers/5f1579c0-907a-490f-ad8e-0fe2db0baf97 => generated 1556 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:46:12.865686 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-ba546d87-7e32-4e82-ade8-ad0b83bcf28a tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:12.866422 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-ba546d87-7e32-4e82-ade8-ad0b83bcf28a tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: 5f1579c0-907a-490f-ad8e-0fe2db0baf97] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:12.876103 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-ba546d87-7e32-4e82-ade8-ad0b83bcf28a tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:12.876921 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-ba546d87-7e32-4e82-ade8-ad0b83bcf28a tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:12.878333 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-ba546d87-7e32-4e82-ade8-ad0b83bcf28a tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:12.879231 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-ba546d87-7e32-4e82-ade8-ad0b83bcf28a tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:13.039620 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-ba546d87-7e32-4e82-ade8-ad0b83bcf28a tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/5f1579c0-907a-490f-ad8e-0fe2db0baf97/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.175933 Jul 19 15:46:13.039620 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 62/155] 10.222.0.64 () {58 vars in 1274 bytes} [Tue Jul 19 15:46:12 2022] GET /compute/v2.1/servers/5f1579c0-907a-490f-ad8e-0fe2db0baf97/os-interface => generated 285 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:46:13.052741 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-890b7791-a947-44f7-bac2-6c44c82e7394 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:13.053678 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-890b7791-a947-44f7-bac2-6c44c82e7394 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 4fa1efb1-1488-48f4-a6ec-9b4787e01277] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:13.063530 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-890b7791-a947-44f7-bac2-6c44c82e7394 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:13.064322 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-890b7791-a947-44f7-bac2-6c44c82e7394 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:13.065238 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-890b7791-a947-44f7-bac2-6c44c82e7394 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:13.065835 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-890b7791-a947-44f7-bac2-6c44c82e7394 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:13.493725 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-890b7791-a947-44f7-bac2-6c44c82e7394 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:46:13.502505 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-890b7791-a947-44f7-bac2-6c44c82e7394 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277" status: 200 len: 1521 microversion: 2.1 time: 0.455139 Jul 19 15:46:13.503315 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 94/156] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:46:13 2022] GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277 => generated 1521 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:46:14.521834 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-8607c463-c1a3-4ae5-b8f5-953425653e70 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:14.522581 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-8607c463-c1a3-4ae5-b8f5-953425653e70 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 4fa1efb1-1488-48f4-a6ec-9b4787e01277] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:14.529476 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-8607c463-c1a3-4ae5-b8f5-953425653e70 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:14.529793 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-8607c463-c1a3-4ae5-b8f5-953425653e70 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:14.530944 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-8607c463-c1a3-4ae5-b8f5-953425653e70 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:14.531495 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-8607c463-c1a3-4ae5-b8f5-953425653e70 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:14.744013 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-8607c463-c1a3-4ae5-b8f5-953425653e70 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:46:14.749689 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG dbcounter [-] [129519] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:46:14.757156 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-8607c463-c1a3-4ae5-b8f5-953425653e70 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277" status: 200 len: 1521 microversion: 2.1 time: 0.239724 Jul 19 15:46:14.758280 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 63/157] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:46:14 2022] GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277 => generated 1521 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:46:14.876180 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [req-61d42253-f0c5-4868-aaf8-2aa93adb6bb1 req-4b79d8ab-dca0-4ffa-9a4e-738504260bf7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5f1579c0-907a-490f-ad8e-0fe2db0baf97", "tag": "c75827cb-3014-46a1-a3d9-1c24d0e5f8f7"}]} {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:46:14.914883 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [req-61d42253-f0c5-4868-aaf8-2aa93adb6bb1 req-4b79d8ab-dca0-4ffa-9a4e-738504260bf7 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:14.915678 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [req-61d42253-f0c5-4868-aaf8-2aa93adb6bb1 req-4b79d8ab-dca0-4ffa-9a4e-738504260bf7 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:14.928262 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.compute.server_external_events [req-61d42253-f0c5-4868-aaf8-2aa93adb6bb1 req-4b79d8ab-dca0-4ffa-9a4e-738504260bf7 service nova] Creating event network-changed:c75827cb-3014-46a1-a3d9-1c24d0e5f8f7 for instance 5f1579c0-907a-490f-ad8e-0fe2db0baf97 on hv-cinder-84902 Jul 19 15:46:14.936119 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [req-61d42253-f0c5-4868-aaf8-2aa93adb6bb1 req-4b79d8ab-dca0-4ffa-9a4e-738504260bf7 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069086 Jul 19 15:46:14.943593 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 95/158] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Jul 19 15:46:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 15:46:15.783391 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-e1bc78ba-1a88-4010-9222-ac0269c1c54d tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:15.785060 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-e1bc78ba-1a88-4010-9222-ac0269c1c54d tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 4fa1efb1-1488-48f4-a6ec-9b4787e01277] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:15.815583 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-e1bc78ba-1a88-4010-9222-ac0269c1c54d tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:15.819902 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-e1bc78ba-1a88-4010-9222-ac0269c1c54d tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:15.820815 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-e1bc78ba-1a88-4010-9222-ac0269c1c54d tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:15.822689 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-e1bc78ba-1a88-4010-9222-ac0269c1c54d tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:16.150756 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-e1bc78ba-1a88-4010-9222-ac0269c1c54d tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:46:16.162339 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-e1bc78ba-1a88-4010-9222-ac0269c1c54d tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277" status: 200 len: 1521 microversion: 2.1 time: 0.390050 Jul 19 15:46:16.172017 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 64/159] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:46:15 2022] GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277 => generated 1521 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:46:17.181495 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-3f767f1f-5070-4c8b-9da7-647395f0e075 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:17.183086 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-3f767f1f-5070-4c8b-9da7-647395f0e075 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 4fa1efb1-1488-48f4-a6ec-9b4787e01277] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:17.191757 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-3f767f1f-5070-4c8b-9da7-647395f0e075 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:17.192565 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-3f767f1f-5070-4c8b-9da7-647395f0e075 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:17.194184 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-3f767f1f-5070-4c8b-9da7-647395f0e075 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:17.194839 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-3f767f1f-5070-4c8b-9da7-647395f0e075 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:17.378218 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-3f767f1f-5070-4c8b-9da7-647395f0e075 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:46:17.385710 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-3f767f1f-5070-4c8b-9da7-647395f0e075 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277" status: 200 len: 1521 microversion: 2.1 time: 0.209154 Jul 19 15:46:17.386278 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 96/160] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:46:17 2022] GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277 => generated 1521 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:46:18.403207 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-86e9535b-081b-445f-a3ae-bf91dd8e2889 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:18.404543 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-86e9535b-081b-445f-a3ae-bf91dd8e2889 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 4fa1efb1-1488-48f4-a6ec-9b4787e01277] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:18.416911 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-86e9535b-081b-445f-a3ae-bf91dd8e2889 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:18.417498 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-86e9535b-081b-445f-a3ae-bf91dd8e2889 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:18.418277 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-86e9535b-081b-445f-a3ae-bf91dd8e2889 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:18.418892 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-86e9535b-081b-445f-a3ae-bf91dd8e2889 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:18.573599 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-86e9535b-081b-445f-a3ae-bf91dd8e2889 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:46:18.583497 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-86e9535b-081b-445f-a3ae-bf91dd8e2889 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277" status: 200 len: 1521 microversion: 2.1 time: 0.183758 Jul 19 15:46:18.584167 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 65/161] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:46:18 2022] GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277 => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:46:19.601843 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-d991d6b8-6ef0-4a5a-9cd5-0fedd2199b86 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:19.602690 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-d991d6b8-6ef0-4a5a-9cd5-0fedd2199b86 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 4fa1efb1-1488-48f4-a6ec-9b4787e01277] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:19.610264 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-d991d6b8-6ef0-4a5a-9cd5-0fedd2199b86 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:19.610726 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-d991d6b8-6ef0-4a5a-9cd5-0fedd2199b86 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:19.611505 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-d991d6b8-6ef0-4a5a-9cd5-0fedd2199b86 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:19.611947 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-d991d6b8-6ef0-4a5a-9cd5-0fedd2199b86 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:19.768903 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-d991d6b8-6ef0-4a5a-9cd5-0fedd2199b86 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:46:19.776957 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-d991d6b8-6ef0-4a5a-9cd5-0fedd2199b86 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277" status: 200 len: 1521 microversion: 2.1 time: 0.179012 Jul 19 15:46:19.777532 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 97/162] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:46:19 2022] GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277 => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:46:20.794189 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-085f3de0-5e1d-4c7b-9319-eb25b39c8f22 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:20.794852 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-085f3de0-5e1d-4c7b-9319-eb25b39c8f22 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 4fa1efb1-1488-48f4-a6ec-9b4787e01277] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:20.802162 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-085f3de0-5e1d-4c7b-9319-eb25b39c8f22 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:20.802635 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-085f3de0-5e1d-4c7b-9319-eb25b39c8f22 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:20.804027 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-085f3de0-5e1d-4c7b-9319-eb25b39c8f22 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:20.804468 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-085f3de0-5e1d-4c7b-9319-eb25b39c8f22 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:20.998390 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-085f3de0-5e1d-4c7b-9319-eb25b39c8f22 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:46:21.006584 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-085f3de0-5e1d-4c7b-9319-eb25b39c8f22 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277" status: 200 len: 1521 microversion: 2.1 time: 0.216259 Jul 19 15:46:21.017418 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 66/163] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:46:20 2022] GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277 => generated 1521 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:46:21.092741 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-0c1694ab-9946-48d3-b39a-66a4a9b13af6 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:21.093306 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-0c1694ab-9946-48d3-b39a-66a4a9b13af6 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] [instance: 82a77751-75d6-4aa5-a0d6-cb1af296b4e7] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:21.100218 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-0c1694ab-9946-48d3-b39a-66a4a9b13af6 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:21.100758 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-0c1694ab-9946-48d3-b39a-66a4a9b13af6 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:21.101830 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-0c1694ab-9946-48d3-b39a-66a4a9b13af6 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:21.102333 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-0c1694ab-9946-48d3-b39a-66a4a9b13af6 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:21.129269 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-0c1694ab-9946-48d3-b39a-66a4a9b13af6 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] [instance: 82a77751-75d6-4aa5-a0d6-cb1af296b4e7] Going to try to terminate instance {{(pid=129520) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 15:46:21.222968 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-0c1694ab-9946-48d3-b39a-66a4a9b13af6 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] 10.222.0.64 "DELETE /compute/v2.1/servers/82a77751-75d6-4aa5-a0d6-cb1af296b4e7" status: 204 len: 0 microversion: 2.1 time: 0.136408 Jul 19 15:46:21.225500 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 98/164] 10.222.0.64 () {58 vars in 1238 bytes} [Tue Jul 19 15:46:21 2022] DELETE /compute/v2.1/servers/82a77751-75d6-4aa5-a0d6-cb1af296b4e7 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 15:46:21.239657 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-34a7939c-8b19-44b6-b9eb-e516402d4982 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:21.240269 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-34a7939c-8b19-44b6-b9eb-e516402d4982 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] [instance: 82a77751-75d6-4aa5-a0d6-cb1af296b4e7] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:21.246544 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-34a7939c-8b19-44b6-b9eb-e516402d4982 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:21.247077 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-34a7939c-8b19-44b6-b9eb-e516402d4982 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:21.247834 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-34a7939c-8b19-44b6-b9eb-e516402d4982 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:21.248362 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-34a7939c-8b19-44b6-b9eb-e516402d4982 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:21.385175 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-34a7939c-8b19-44b6-b9eb-e516402d4982 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831d1557afd649518d34d4f970f96674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905aecc2e33f4befb1a47740e8d53611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:46:21.393461 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-34a7939c-8b19-44b6-b9eb-e516402d4982 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] 10.222.0.64 "GET /compute/v2.1/servers/82a77751-75d6-4aa5-a0d6-cb1af296b4e7" status: 200 len: 1553 microversion: 2.1 time: 0.163545 Jul 19 15:46:21.394124 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 67/165] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:46:21 2022] GET /compute/v2.1/servers/82a77751-75d6-4aa5-a0d6-cb1af296b4e7 => generated 1553 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:46:22.025239 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-466943a2-9263-4e5d-a3d4-24304d9ac104 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:22.025917 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-466943a2-9263-4e5d-a3d4-24304d9ac104 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 4fa1efb1-1488-48f4-a6ec-9b4787e01277] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:22.033008 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-466943a2-9263-4e5d-a3d4-24304d9ac104 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:22.033527 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-466943a2-9263-4e5d-a3d4-24304d9ac104 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:22.034204 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-466943a2-9263-4e5d-a3d4-24304d9ac104 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:22.034662 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-466943a2-9263-4e5d-a3d4-24304d9ac104 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:22.173374 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-466943a2-9263-4e5d-a3d4-24304d9ac104 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:46:22.181307 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-466943a2-9263-4e5d-a3d4-24304d9ac104 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277" status: 200 len: 1521 microversion: 2.1 time: 0.160189 Jul 19 15:46:22.182308 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 99/166] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:46:22 2022] GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:46:22.413170 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-47a6222a-92fd-46c0-b7ea-96915841b2a0 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:22.413918 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-47a6222a-92fd-46c0-b7ea-96915841b2a0 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] [instance: 82a77751-75d6-4aa5-a0d6-cb1af296b4e7] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:22.423605 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-47a6222a-92fd-46c0-b7ea-96915841b2a0 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:22.423605 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-47a6222a-92fd-46c0-b7ea-96915841b2a0 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:22.432132 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-47a6222a-92fd-46c0-b7ea-96915841b2a0 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:22.432433 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-47a6222a-92fd-46c0-b7ea-96915841b2a0 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:22.894894 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-47a6222a-92fd-46c0-b7ea-96915841b2a0 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831d1557afd649518d34d4f970f96674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905aecc2e33f4befb1a47740e8d53611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:46:22.903491 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-47a6222a-92fd-46c0-b7ea-96915841b2a0 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] 10.222.0.64 "GET /compute/v2.1/servers/82a77751-75d6-4aa5-a0d6-cb1af296b4e7" status: 200 len: 1553 microversion: 2.1 time: 0.494926 Jul 19 15:46:22.904327 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 68/167] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:46:22 2022] GET /compute/v2.1/servers/82a77751-75d6-4aa5-a0d6-cb1af296b4e7 => generated 1553 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:46:23.197845 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-0a51e861-9a6d-44fe-83c6-d13cfcde9f87 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:23.198377 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-0a51e861-9a6d-44fe-83c6-d13cfcde9f87 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 4fa1efb1-1488-48f4-a6ec-9b4787e01277] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:23.205494 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-0a51e861-9a6d-44fe-83c6-d13cfcde9f87 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:23.206265 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-0a51e861-9a6d-44fe-83c6-d13cfcde9f87 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:23.207057 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-0a51e861-9a6d-44fe-83c6-d13cfcde9f87 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:23.207505 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-0a51e861-9a6d-44fe-83c6-d13cfcde9f87 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:23.523373 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-0a51e861-9a6d-44fe-83c6-d13cfcde9f87 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:46:23.527194 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG dbcounter [-] [129520] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:46:23.532632 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-0a51e861-9a6d-44fe-83c6-d13cfcde9f87 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277" status: 200 len: 1521 microversion: 2.1 time: 0.338787 Jul 19 15:46:23.533211 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 100/168] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:46:23 2022] GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277 => generated 1521 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:46:23.922315 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-0b8da97c-649f-4993-bda3-a62a88d79883 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:23.923650 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-0b8da97c-649f-4993-bda3-a62a88d79883 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] [instance: 82a77751-75d6-4aa5-a0d6-cb1af296b4e7] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:23.933106 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-0b8da97c-649f-4993-bda3-a62a88d79883 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:23.933792 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-0b8da97c-649f-4993-bda3-a62a88d79883 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:23.934782 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-0b8da97c-649f-4993-bda3-a62a88d79883 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:23.935478 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-0b8da97c-649f-4993-bda3-a62a88d79883 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:24.180451 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-0b8da97c-649f-4993-bda3-a62a88d79883 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831d1557afd649518d34d4f970f96674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905aecc2e33f4befb1a47740e8d53611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:46:24.193413 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-0b8da97c-649f-4993-bda3-a62a88d79883 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] 10.222.0.64 "GET /compute/v2.1/servers/82a77751-75d6-4aa5-a0d6-cb1af296b4e7" status: 200 len: 1553 microversion: 2.1 time: 0.276058 Jul 19 15:46:24.194008 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 69/169] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:46:23 2022] GET /compute/v2.1/servers/82a77751-75d6-4aa5-a0d6-cb1af296b4e7 => generated 1553 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:46:24.483705 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [req-d1298d10-1659-4091-baa0-80f361518fae req-09517730-53e4-4d14-aa4d-ce4b2ec3e699 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "82a77751-75d6-4aa5-a0d6-cb1af296b4e7", "name": "network-vif-deleted", "tag": "8cd72be0-aaa1-41b3-a6d5-52edc3f63b70"}]} {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:46:24.496478 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [req-d1298d10-1659-4091-baa0-80f361518fae req-09517730-53e4-4d14-aa4d-ce4b2ec3e699 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:24.496873 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [req-d1298d10-1659-4091-baa0-80f361518fae req-09517730-53e4-4d14-aa4d-ce4b2ec3e699 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:24.512331 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.compute.server_external_events [req-d1298d10-1659-4091-baa0-80f361518fae req-09517730-53e4-4d14-aa4d-ce4b2ec3e699 service nova] Creating event network-vif-deleted:8cd72be0-aaa1-41b3-a6d5-52edc3f63b70 for instance 82a77751-75d6-4aa5-a0d6-cb1af296b4e7 on hv-cinder-84902 Jul 19 15:46:24.519898 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [req-d1298d10-1659-4091-baa0-80f361518fae req-09517730-53e4-4d14-aa4d-ce4b2ec3e699 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041968 Jul 19 15:46:24.521032 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 101/170] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Jul 19 15:46:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:46:24.551641 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-8c5062d2-0c27-4cbb-b927-8493088437d1 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:24.552337 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-8c5062d2-0c27-4cbb-b927-8493088437d1 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 4fa1efb1-1488-48f4-a6ec-9b4787e01277] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:24.561451 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-8c5062d2-0c27-4cbb-b927-8493088437d1 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:24.561844 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-8c5062d2-0c27-4cbb-b927-8493088437d1 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:24.562684 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-8c5062d2-0c27-4cbb-b927-8493088437d1 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:24.563120 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-8c5062d2-0c27-4cbb-b927-8493088437d1 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:24.763055 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-8c5062d2-0c27-4cbb-b927-8493088437d1 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:46:24.772758 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-8c5062d2-0c27-4cbb-b927-8493088437d1 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277" status: 200 len: 1521 microversion: 2.1 time: 0.226236 Jul 19 15:46:24.775177 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 70/171] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:46:24 2022] GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277 => generated 1521 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:46:25.213670 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-ea76659f-03e1-4004-a1ee-75f52f8d875a tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:25.214710 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-ea76659f-03e1-4004-a1ee-75f52f8d875a tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] [instance: 82a77751-75d6-4aa5-a0d6-cb1af296b4e7] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:25.226690 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-ea76659f-03e1-4004-a1ee-75f52f8d875a tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:25.227328 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-ea76659f-03e1-4004-a1ee-75f52f8d875a tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:25.228189 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-ea76659f-03e1-4004-a1ee-75f52f8d875a tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:25.228870 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-ea76659f-03e1-4004-a1ee-75f52f8d875a tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:25.288173 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-ea76659f-03e1-4004-a1ee-75f52f8d875a tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:25.288929 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-ea76659f-03e1-4004-a1ee-75f52f8d875a tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:25.289520 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.objects.instance [None req-ea76659f-03e1-4004-a1ee-75f52f8d875a tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lazy-loading 'fault' on Instance uuid 82a77751-75d6-4aa5-a0d6-cb1af296b4e7 {{(pid=129520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 15:46:25.359119 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-ea76659f-03e1-4004-a1ee-75f52f8d875a tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '831d1557afd649518d34d4f970f96674', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '905aecc2e33f4befb1a47740e8d53611', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:46:25.368212 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-ea76659f-03e1-4004-a1ee-75f52f8d875a tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] 10.222.0.64 "GET /compute/v2.1/servers/82a77751-75d6-4aa5-a0d6-cb1af296b4e7" status: 200 len: 1351 microversion: 2.1 time: 0.159913 Jul 19 15:46:25.369144 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 102/172] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:46:25 2022] GET /compute/v2.1/servers/82a77751-75d6-4aa5-a0d6-cb1af296b4e7 => generated 1351 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:46:25.792135 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-95c33442-8149-4727-8b87-f49b3afc349d tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:25.792868 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-95c33442-8149-4727-8b87-f49b3afc349d tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 4fa1efb1-1488-48f4-a6ec-9b4787e01277] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:25.799641 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-95c33442-8149-4727-8b87-f49b3afc349d tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:25.800089 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-95c33442-8149-4727-8b87-f49b3afc349d tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:25.801031 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-95c33442-8149-4727-8b87-f49b3afc349d tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:25.801470 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-95c33442-8149-4727-8b87-f49b3afc349d tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:25.965916 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-95c33442-8149-4727-8b87-f49b3afc349d tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:46:25.974576 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-95c33442-8149-4727-8b87-f49b3afc349d tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277" status: 200 len: 1521 microversion: 2.1 time: 0.186511 Jul 19 15:46:25.975139 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 71/173] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:46:25 2022] GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277 => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:46:26.386539 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-66e0cda6-0f12-4785-9855-cb71ec3df8fa tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:26.388104 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-66e0cda6-0f12-4785-9855-cb71ec3df8fa tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] [instance: 82a77751-75d6-4aa5-a0d6-cb1af296b4e7] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:26.397628 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-66e0cda6-0f12-4785-9855-cb71ec3df8fa tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:26.399144 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-66e0cda6-0f12-4785-9855-cb71ec3df8fa tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:26.403274 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-66e0cda6-0f12-4785-9855-cb71ec3df8fa tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:26.404160 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-66e0cda6-0f12-4785-9855-cb71ec3df8fa tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:26.435492 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.wsgi [None req-66e0cda6-0f12-4785-9855-cb71ec3df8fa tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] HTTP exception thrown: Instance 82a77751-75d6-4aa5-a0d6-cb1af296b4e7 could not be found. Jul 19 15:46:26.441491 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-66e0cda6-0f12-4785-9855-cb71ec3df8fa tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Request method failure captured: Jul 19 15:46:26.441491 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: request: GET /compute/v2.1/servers/82a77751-75d6-4aa5-a0d6-cb1af296b4e7 HTTP/1.1 Jul 19 15:46:26.441491 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Accept: application/json Jul 19 15:46:26.441491 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Accept-Encoding: identity Jul 19 15:46:26.441491 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Connection: close Jul 19 15:46:26.441491 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Content-Length: 0 Jul 19 15:46:26.441491 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Content-Type: application/json Jul 19 15:46:26.441491 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Host: 10.222.0.64 Jul 19 15:46:26.441491 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Openstack-System-Scope: None Jul 19 15:46:26.441491 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: User-Agent: python-urllib3/1.26.9 Jul 19 15:46:26.441491 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Auth-Token: gAAAAABi1tGNUGpo8hdyHjLHRuksjtY7jAxm3wzWFLCJyP9Uqjjkuo0yUTz5J3yd4fmozJo8HaoTFEaxAg0Rc70Yrn4VvoobNb7K81JaB8UF8bUPi0_3lEDzZRs6q4esM9sNgT3c6FgddMhZLdkUhrmeOX4TfyfGbMPBJ7-rkxQ5KfQIkgCybD4 Jul 19 15:46:26.441491 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Domain-Id: None Jul 19 15:46:26.441491 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Domain-Name: None Jul 19 15:46:26.441491 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Identity-Status: Confirmed Jul 19 15:46:26.441491 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Is-Admin-Project: True Jul 19 15:46:26.441491 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Project-Domain-Id: default Jul 19 15:46:26.441491 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Project-Domain-Name: Default Jul 19 15:46:26.441491 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Project-Id: 905aecc2e33f4befb1a47740e8d53611 Jul 19 15:46:26.441491 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Project-Name: tempest-DeleteServersTestJSON-1399239002 Jul 19 15:46:26.441491 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Role: member,reader Jul 19 15:46:26.441491 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Roles: member,reader Jul 19 15:46:26.443121 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_905aecc2e33f4befb1a47740e8d53611", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/905aecc2e33f4befb1a47740e8d53611"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/905aecc2e33f4befb1a47740e8d53611"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/905aecc2e33f4befb1a47740e8d53611"}]}] Jul 19 15:46:26.443121 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Tenant: tempest-DeleteServersTestJSON-1399239002 Jul 19 15:46:26.443121 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Tenant-Id: 905aecc2e33f4befb1a47740e8d53611 Jul 19 15:46:26.443121 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Tenant-Name: tempest-DeleteServersTestJSON-1399239002 Jul 19 15:46:26.443121 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User: tempest-DeleteServersTestJSON-1399239002-project Jul 19 15:46:26.443121 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User-Domain-Id: default Jul 19 15:46:26.443121 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User-Domain-Name: Default Jul 19 15:46:26.443121 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User-Id: 831d1557afd649518d34d4f970f96674 Jul 19 15:46:26.443121 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User-Name: tempest-DeleteServersTestJSON-1399239002-project Jul 19 15:46:26.443121 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: method: > Jul 19 15:46:26.443121 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: exception: Instance 82a77751-75d6-4aa5-a0d6-cb1af296b4e7 could not be found. Jul 19 15:46:26.443121 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: action_args: {'id': '82a77751-75d6-4aa5-a0d6-cb1af296b4e7'} Jul 19 15:46:26.443968 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:46:26.443968 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:46:26.443968 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 15:46:26.443968 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 15:46:26.443968 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 15:46:26.443968 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 15:46:26.443968 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 15:46:26.443968 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 15:46:26.443968 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 15:46:26.443968 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 15:46:26.443968 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82a77751-75d6-4aa5-a0d6-cb1af296b4e7 could not be found. Jul 19 15:46:26.443968 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:46:26.443968 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:46:26.443968 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:46:26.443968 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:46:26.443968 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:46:26.443968 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:46:26.443968 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:46:26.443968 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:46:26.443968 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:46:26.445278 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:46:26.445278 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 15:46:26.445278 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 15:46:26.445278 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 15:46:26.445278 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 15:46:26.445278 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 15:46:26.445278 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 15:46:26.445278 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82a77751-75d6-4aa5-a0d6-cb1af296b4e7 could not be found. Jul 19 15:46:26.445278 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:46:26.445278 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:46:26.445278 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:46:26.445278 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:46:26.445278 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:46:26.445278 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:46:26.445278 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:46:26.445278 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:46:26.445278 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82a77751-75d6-4aa5-a0d6-cb1af296b4e7 could not be found. Jul 19 15:46:26.445278 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:46:26.446507 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-66e0cda6-0f12-4785-9855-cb71ec3df8fa tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Returning 404 to user: Instance 82a77751-75d6-4aa5-a0d6-cb1af296b4e7 could not be found. {{(pid=129520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:46:26.446507 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-66e0cda6-0f12-4785-9855-cb71ec3df8fa tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] 10.222.0.64 "GET /compute/v2.1/servers/82a77751-75d6-4aa5-a0d6-cb1af296b4e7" status: 404 len: 111 microversion: 2.1 time: 0.061475 Jul 19 15:46:26.448222 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 103/174] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:46:26 2022] GET /compute/v2.1/servers/82a77751-75d6-4aa5-a0d6-cb1af296b4e7 => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 15:46:26.614380 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-54b6a8cf-3058-45b9-a24b-17e71b46e844 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:26.622838 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-54b6a8cf-3058-45b9-a24b-17e71b46e844 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] [instance: 82a77751-75d6-4aa5-a0d6-cb1af296b4e7] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:26.639772 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-54b6a8cf-3058-45b9-a24b-17e71b46e844 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:26.640629 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-54b6a8cf-3058-45b9-a24b-17e71b46e844 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:26.641598 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-54b6a8cf-3058-45b9-a24b-17e71b46e844 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:26.642979 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-54b6a8cf-3058-45b9-a24b-17e71b46e844 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:26.658732 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.wsgi [None req-54b6a8cf-3058-45b9-a24b-17e71b46e844 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] HTTP exception thrown: Instance 82a77751-75d6-4aa5-a0d6-cb1af296b4e7 could not be found. Jul 19 15:46:26.663289 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-54b6a8cf-3058-45b9-a24b-17e71b46e844 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Request method failure captured: Jul 19 15:46:26.663289 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: request: GET /compute/v2.1/servers/82a77751-75d6-4aa5-a0d6-cb1af296b4e7/os-volume_attachments HTTP/1.1 Jul 19 15:46:26.663289 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Accept: application/json Jul 19 15:46:26.663289 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Accept-Encoding: identity Jul 19 15:46:26.663289 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Connection: close Jul 19 15:46:26.663289 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Content-Length: 0 Jul 19 15:46:26.663289 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Content-Type: application/json Jul 19 15:46:26.663289 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Host: 10.222.0.64 Jul 19 15:46:26.663289 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Openstack-System-Scope: None Jul 19 15:46:26.663289 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: User-Agent: python-urllib3/1.26.9 Jul 19 15:46:26.663289 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Auth-Token: gAAAAABi1tGNUGpo8hdyHjLHRuksjtY7jAxm3wzWFLCJyP9Uqjjkuo0yUTz5J3yd4fmozJo8HaoTFEaxAg0Rc70Yrn4VvoobNb7K81JaB8UF8bUPi0_3lEDzZRs6q4esM9sNgT3c6FgddMhZLdkUhrmeOX4TfyfGbMPBJ7-rkxQ5KfQIkgCybD4 Jul 19 15:46:26.663289 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Domain-Id: None Jul 19 15:46:26.663289 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Domain-Name: None Jul 19 15:46:26.663289 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Identity-Status: Confirmed Jul 19 15:46:26.663289 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Is-Admin-Project: True Jul 19 15:46:26.663289 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Domain-Id: default Jul 19 15:46:26.663289 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Domain-Name: Default Jul 19 15:46:26.663289 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Id: 905aecc2e33f4befb1a47740e8d53611 Jul 19 15:46:26.663289 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Name: tempest-DeleteServersTestJSON-1399239002 Jul 19 15:46:26.663289 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Role: member,reader Jul 19 15:46:26.663289 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Roles: member,reader Jul 19 15:46:26.664470 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_905aecc2e33f4befb1a47740e8d53611", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/905aecc2e33f4befb1a47740e8d53611"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/905aecc2e33f4befb1a47740e8d53611"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/905aecc2e33f4befb1a47740e8d53611"}]}] Jul 19 15:46:26.664470 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Tenant: tempest-DeleteServersTestJSON-1399239002 Jul 19 15:46:26.664470 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Tenant-Id: 905aecc2e33f4befb1a47740e8d53611 Jul 19 15:46:26.664470 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Tenant-Name: tempest-DeleteServersTestJSON-1399239002 Jul 19 15:46:26.664470 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User: tempest-DeleteServersTestJSON-1399239002-project Jul 19 15:46:26.664470 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Domain-Id: default Jul 19 15:46:26.664470 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Domain-Name: Default Jul 19 15:46:26.664470 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Id: 831d1557afd649518d34d4f970f96674 Jul 19 15:46:26.664470 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Name: tempest-DeleteServersTestJSON-1399239002-project Jul 19 15:46:26.664470 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: method: > Jul 19 15:46:26.664470 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: exception: Instance 82a77751-75d6-4aa5-a0d6-cb1af296b4e7 could not be found. Jul 19 15:46:26.664470 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: action_args: {'server_id': '82a77751-75d6-4aa5-a0d6-cb1af296b4e7'} Jul 19 15:46:26.665109 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:46:26.665109 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:46:26.665109 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 15:46:26.665109 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 15:46:26.665109 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 15:46:26.665109 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 15:46:26.665109 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 15:46:26.665109 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 15:46:26.665109 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 15:46:26.665109 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 15:46:26.665109 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82a77751-75d6-4aa5-a0d6-cb1af296b4e7 could not be found. Jul 19 15:46:26.665109 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:46:26.665109 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:46:26.665109 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:46:26.665109 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:46:26.665109 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:46:26.665109 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:46:26.665109 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:46:26.665109 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:46:26.665109 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:46:26.666141 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:46:26.666141 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 19 15:46:26.666141 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 15:46:26.666141 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 19 15:46:26.666141 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 15:46:26.666141 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 19 15:46:26.666141 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 19 15:46:26.666141 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 15:46:26.666141 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 15:46:26.666141 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82a77751-75d6-4aa5-a0d6-cb1af296b4e7 could not be found. Jul 19 15:46:26.666141 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:46:26.666141 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:46:26.666141 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:46:26.666141 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:46:26.666141 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:46:26.666141 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:46:26.666141 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:46:26.666141 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:46:26.666141 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82a77751-75d6-4aa5-a0d6-cb1af296b4e7 could not be found. Jul 19 15:46:26.666141 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:46:26.667222 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-54b6a8cf-3058-45b9-a24b-17e71b46e844 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Returning 404 to user: Instance 82a77751-75d6-4aa5-a0d6-cb1af296b4e7 could not be found. {{(pid=129519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:46:26.667222 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-54b6a8cf-3058-45b9-a24b-17e71b46e844 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] 10.222.0.64 "GET /compute/v2.1/servers/82a77751-75d6-4aa5-a0d6-cb1af296b4e7/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.054378 Jul 19 15:46:26.679405 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 72/175] 10.222.0.64 () {58 vars in 1301 bytes} [Tue Jul 19 15:46:26 2022] GET /compute/v2.1/servers/82a77751-75d6-4aa5-a0d6-cb1af296b4e7/os-volume_attachments => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 15:46:26.992873 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-276af320-979f-4cc1-b7a7-1065b9d2f5d8 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:26.993759 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-276af320-979f-4cc1-b7a7-1065b9d2f5d8 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 4fa1efb1-1488-48f4-a6ec-9b4787e01277] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:27.002261 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-276af320-979f-4cc1-b7a7-1065b9d2f5d8 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:27.003133 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-276af320-979f-4cc1-b7a7-1065b9d2f5d8 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:27.004253 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-276af320-979f-4cc1-b7a7-1065b9d2f5d8 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:27.004959 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-276af320-979f-4cc1-b7a7-1065b9d2f5d8 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:27.171127 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-276af320-979f-4cc1-b7a7-1065b9d2f5d8 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:46:27.179196 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-276af320-979f-4cc1-b7a7-1065b9d2f5d8 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277" status: 200 len: 1521 microversion: 2.1 time: 0.191221 Jul 19 15:46:27.179770 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 104/176] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:46:26 2022] GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277 => generated 1521 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:46:27.944698 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-f70853d6-1b30-4066-96bf-8c6b9180abf5 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:27.945870 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-f70853d6-1b30-4066-96bf-8c6b9180abf5 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] [instance: 82a77751-75d6-4aa5-a0d6-cb1af296b4e7] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:27.954128 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-f70853d6-1b30-4066-96bf-8c6b9180abf5 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:27.954789 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-f70853d6-1b30-4066-96bf-8c6b9180abf5 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:27.956259 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-f70853d6-1b30-4066-96bf-8c6b9180abf5 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:27.956825 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-f70853d6-1b30-4066-96bf-8c6b9180abf5 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:27.973440 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.wsgi [None req-f70853d6-1b30-4066-96bf-8c6b9180abf5 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] HTTP exception thrown: Instance 82a77751-75d6-4aa5-a0d6-cb1af296b4e7 could not be found. Jul 19 15:46:27.976391 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-f70853d6-1b30-4066-96bf-8c6b9180abf5 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Request method failure captured: Jul 19 15:46:27.976391 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: request: DELETE /compute/v2.1/servers/82a77751-75d6-4aa5-a0d6-cb1af296b4e7 HTTP/1.1 Jul 19 15:46:27.976391 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Accept: application/json Jul 19 15:46:27.976391 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Accept-Encoding: identity Jul 19 15:46:27.976391 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Connection: close Jul 19 15:46:27.976391 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Content-Length: 0 Jul 19 15:46:27.976391 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Content-Type: application/json Jul 19 15:46:27.976391 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Host: 10.222.0.64 Jul 19 15:46:27.976391 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Openstack-System-Scope: None Jul 19 15:46:27.976391 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: User-Agent: python-urllib3/1.26.9 Jul 19 15:46:27.976391 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Auth-Token: gAAAAABi1tGNUGpo8hdyHjLHRuksjtY7jAxm3wzWFLCJyP9Uqjjkuo0yUTz5J3yd4fmozJo8HaoTFEaxAg0Rc70Yrn4VvoobNb7K81JaB8UF8bUPi0_3lEDzZRs6q4esM9sNgT3c6FgddMhZLdkUhrmeOX4TfyfGbMPBJ7-rkxQ5KfQIkgCybD4 Jul 19 15:46:27.976391 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Domain-Id: None Jul 19 15:46:27.976391 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Domain-Name: None Jul 19 15:46:27.976391 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Identity-Status: Confirmed Jul 19 15:46:27.976391 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Is-Admin-Project: True Jul 19 15:46:27.976391 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Domain-Id: default Jul 19 15:46:27.976391 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Domain-Name: Default Jul 19 15:46:27.976391 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Id: 905aecc2e33f4befb1a47740e8d53611 Jul 19 15:46:27.976391 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Name: tempest-DeleteServersTestJSON-1399239002 Jul 19 15:46:27.976391 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Role: member,reader Jul 19 15:46:27.976391 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Roles: member,reader Jul 19 15:46:27.978054 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_905aecc2e33f4befb1a47740e8d53611", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/905aecc2e33f4befb1a47740e8d53611"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/905aecc2e33f4befb1a47740e8d53611"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/905aecc2e33f4befb1a47740e8d53611"}]}] Jul 19 15:46:27.978054 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Tenant: tempest-DeleteServersTestJSON-1399239002 Jul 19 15:46:27.978054 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Tenant-Id: 905aecc2e33f4befb1a47740e8d53611 Jul 19 15:46:27.978054 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Tenant-Name: tempest-DeleteServersTestJSON-1399239002 Jul 19 15:46:27.978054 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User: tempest-DeleteServersTestJSON-1399239002-project Jul 19 15:46:27.978054 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Domain-Id: default Jul 19 15:46:27.978054 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Domain-Name: Default Jul 19 15:46:27.978054 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Id: 831d1557afd649518d34d4f970f96674 Jul 19 15:46:27.978054 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Name: tempest-DeleteServersTestJSON-1399239002-project Jul 19 15:46:27.978054 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: method: > Jul 19 15:46:27.978054 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: exception: Instance 82a77751-75d6-4aa5-a0d6-cb1af296b4e7 could not be found. Jul 19 15:46:27.978054 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: action_args: {'id': '82a77751-75d6-4aa5-a0d6-cb1af296b4e7'} Jul 19 15:46:27.978901 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:46:27.978901 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:46:27.978901 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 15:46:27.978901 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 15:46:27.978901 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 15:46:27.978901 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 15:46:27.978901 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 15:46:27.978901 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 15:46:27.978901 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 15:46:27.978901 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 15:46:27.978901 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82a77751-75d6-4aa5-a0d6-cb1af296b4e7 could not be found. Jul 19 15:46:27.978901 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:46:27.978901 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:46:27.978901 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:46:27.978901 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:46:27.978901 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:46:27.978901 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:46:27.978901 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:46:27.978901 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:46:27.978901 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:46:27.984063 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:46:27.984063 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 15:46:27.984063 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 15:46:27.984063 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 15:46:27.984063 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 15:46:27.984063 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 15:46:27.984063 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 15:46:27.984063 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 15:46:27.984063 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 15:46:27.984063 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82a77751-75d6-4aa5-a0d6-cb1af296b4e7 could not be found. Jul 19 15:46:27.984063 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:46:27.984063 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:46:27.984063 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:46:27.984063 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:46:27.984063 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:46:27.984063 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:46:27.984063 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:46:27.984063 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:46:27.984063 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82a77751-75d6-4aa5-a0d6-cb1af296b4e7 could not be found. Jul 19 15:46:27.984063 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:46:27.986949 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-f70853d6-1b30-4066-96bf-8c6b9180abf5 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Returning 404 to user: Instance 82a77751-75d6-4aa5-a0d6-cb1af296b4e7 could not be found. {{(pid=129519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:46:27.987990 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-f70853d6-1b30-4066-96bf-8c6b9180abf5 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] 10.222.0.64 "DELETE /compute/v2.1/servers/82a77751-75d6-4aa5-a0d6-cb1af296b4e7" status: 404 len: 111 microversion: 2.1 time: 0.047225 Jul 19 15:46:27.988543 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 73/177] 10.222.0.64 () {58 vars in 1238 bytes} [Tue Jul 19 15:46:27 2022] DELETE /compute/v2.1/servers/82a77751-75d6-4aa5-a0d6-cb1af296b4e7 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 15:46:27.996791 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-ffe82314-23de-4448-9f0c-3014661798b9 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:27.997469 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-ffe82314-23de-4448-9f0c-3014661798b9 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] [instance: 82a77751-75d6-4aa5-a0d6-cb1af296b4e7] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:28.004462 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-ffe82314-23de-4448-9f0c-3014661798b9 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:28.004969 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-ffe82314-23de-4448-9f0c-3014661798b9 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:28.005946 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-ffe82314-23de-4448-9f0c-3014661798b9 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:28.009623 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-ffe82314-23de-4448-9f0c-3014661798b9 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:28.020579 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.wsgi [None req-ffe82314-23de-4448-9f0c-3014661798b9 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] HTTP exception thrown: Instance 82a77751-75d6-4aa5-a0d6-cb1af296b4e7 could not be found. Jul 19 15:46:28.022207 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-ffe82314-23de-4448-9f0c-3014661798b9 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Request method failure captured: Jul 19 15:46:28.022207 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: request: GET /compute/v2.1/servers/82a77751-75d6-4aa5-a0d6-cb1af296b4e7 HTTP/1.1 Jul 19 15:46:28.022207 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Accept: application/json Jul 19 15:46:28.022207 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Accept-Encoding: identity Jul 19 15:46:28.022207 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Connection: close Jul 19 15:46:28.022207 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Content-Length: 0 Jul 19 15:46:28.022207 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Content-Type: application/json Jul 19 15:46:28.022207 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Host: 10.222.0.64 Jul 19 15:46:28.022207 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Openstack-System-Scope: None Jul 19 15:46:28.022207 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: User-Agent: python-urllib3/1.26.9 Jul 19 15:46:28.022207 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Auth-Token: gAAAAABi1tGNUGpo8hdyHjLHRuksjtY7jAxm3wzWFLCJyP9Uqjjkuo0yUTz5J3yd4fmozJo8HaoTFEaxAg0Rc70Yrn4VvoobNb7K81JaB8UF8bUPi0_3lEDzZRs6q4esM9sNgT3c6FgddMhZLdkUhrmeOX4TfyfGbMPBJ7-rkxQ5KfQIkgCybD4 Jul 19 15:46:28.022207 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Domain-Id: None Jul 19 15:46:28.022207 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Domain-Name: None Jul 19 15:46:28.022207 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Identity-Status: Confirmed Jul 19 15:46:28.022207 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Is-Admin-Project: True Jul 19 15:46:28.022207 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Project-Domain-Id: default Jul 19 15:46:28.022207 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Project-Domain-Name: Default Jul 19 15:46:28.022207 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Project-Id: 905aecc2e33f4befb1a47740e8d53611 Jul 19 15:46:28.022207 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Project-Name: tempest-DeleteServersTestJSON-1399239002 Jul 19 15:46:28.022207 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Role: member,reader Jul 19 15:46:28.022207 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Roles: member,reader Jul 19 15:46:28.023705 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_905aecc2e33f4befb1a47740e8d53611", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/905aecc2e33f4befb1a47740e8d53611"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/905aecc2e33f4befb1a47740e8d53611"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/905aecc2e33f4befb1a47740e8d53611"}]}] Jul 19 15:46:28.023705 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Tenant: tempest-DeleteServersTestJSON-1399239002 Jul 19 15:46:28.023705 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Tenant-Id: 905aecc2e33f4befb1a47740e8d53611 Jul 19 15:46:28.023705 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Tenant-Name: tempest-DeleteServersTestJSON-1399239002 Jul 19 15:46:28.023705 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User: tempest-DeleteServersTestJSON-1399239002-project Jul 19 15:46:28.023705 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User-Domain-Id: default Jul 19 15:46:28.023705 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User-Domain-Name: Default Jul 19 15:46:28.023705 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User-Id: 831d1557afd649518d34d4f970f96674 Jul 19 15:46:28.023705 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User-Name: tempest-DeleteServersTestJSON-1399239002-project Jul 19 15:46:28.023705 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: method: > Jul 19 15:46:28.023705 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: exception: Instance 82a77751-75d6-4aa5-a0d6-cb1af296b4e7 could not be found. Jul 19 15:46:28.023705 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: action_args: {'id': '82a77751-75d6-4aa5-a0d6-cb1af296b4e7'} Jul 19 15:46:28.024597 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:46:28.024597 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:46:28.024597 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 15:46:28.024597 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 15:46:28.024597 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 15:46:28.024597 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 15:46:28.024597 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 15:46:28.024597 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 15:46:28.024597 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 15:46:28.024597 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 15:46:28.024597 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 82a77751-75d6-4aa5-a0d6-cb1af296b4e7 could not be found. Jul 19 15:46:28.024597 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:46:28.024597 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:46:28.024597 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:46:28.024597 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:46:28.024597 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:46:28.024597 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:46:28.024597 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:46:28.024597 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:46:28.024597 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:46:28.025852 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:46:28.025852 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 15:46:28.025852 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 15:46:28.025852 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 15:46:28.025852 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 15:46:28.025852 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 15:46:28.025852 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 15:46:28.025852 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 82a77751-75d6-4aa5-a0d6-cb1af296b4e7 could not be found. Jul 19 15:46:28.025852 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:46:28.025852 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:46:28.025852 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:46:28.025852 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:46:28.025852 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:46:28.025852 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:46:28.025852 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:46:28.025852 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:46:28.025852 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 82a77751-75d6-4aa5-a0d6-cb1af296b4e7 could not be found. Jul 19 15:46:28.025852 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:46:28.027053 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-ffe82314-23de-4448-9f0c-3014661798b9 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] Returning 404 to user: Instance 82a77751-75d6-4aa5-a0d6-cb1af296b4e7 could not be found. {{(pid=129520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:46:28.027053 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-ffe82314-23de-4448-9f0c-3014661798b9 tempest-DeleteServersTestJSON-1399239002 tempest-DeleteServersTestJSON-1399239002-project] 10.222.0.64 "GET /compute/v2.1/servers/82a77751-75d6-4aa5-a0d6-cb1af296b4e7" status: 404 len: 111 microversion: 2.1 time: 0.032199 Jul 19 15:46:28.031555 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 105/178] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:46:27 2022] GET /compute/v2.1/servers/82a77751-75d6-4aa5-a0d6-cb1af296b4e7 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 15:46:28.198011 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-18ab8ab0-48ff-4509-a4b1-41e6557c780b tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:28.198842 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-18ab8ab0-48ff-4509-a4b1-41e6557c780b tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 4fa1efb1-1488-48f4-a6ec-9b4787e01277] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:28.208640 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-18ab8ab0-48ff-4509-a4b1-41e6557c780b tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:28.209348 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-18ab8ab0-48ff-4509-a4b1-41e6557c780b tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:28.210423 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-18ab8ab0-48ff-4509-a4b1-41e6557c780b tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:28.211050 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-18ab8ab0-48ff-4509-a4b1-41e6557c780b tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:28.379859 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-18ab8ab0-48ff-4509-a4b1-41e6557c780b tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:46:28.392551 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-18ab8ab0-48ff-4509-a4b1-41e6557c780b tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277" status: 200 len: 1521 microversion: 2.1 time: 0.198620 Jul 19 15:46:28.401927 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 74/179] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:46:28 2022] GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277 => generated 1521 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:46:29.411078 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-24ad9cce-9cd7-463f-954d-6e2bb96b77bb tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:29.412244 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-24ad9cce-9cd7-463f-954d-6e2bb96b77bb tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 4fa1efb1-1488-48f4-a6ec-9b4787e01277] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:29.424039 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-24ad9cce-9cd7-463f-954d-6e2bb96b77bb tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:29.427967 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-24ad9cce-9cd7-463f-954d-6e2bb96b77bb tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:29.428478 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-24ad9cce-9cd7-463f-954d-6e2bb96b77bb tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:29.429027 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-24ad9cce-9cd7-463f-954d-6e2bb96b77bb tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:29.769867 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-24ad9cce-9cd7-463f-954d-6e2bb96b77bb tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:46:29.777315 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-24ad9cce-9cd7-463f-954d-6e2bb96b77bb tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277" status: 200 len: 1521 microversion: 2.1 time: 0.370744 Jul 19 15:46:29.778492 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 106/180] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:46:29 2022] GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277 => generated 1521 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:46:30.797117 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-03ae5b9d-dbe9-4885-ae13-b13440e3f319 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:30.798212 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-03ae5b9d-dbe9-4885-ae13-b13440e3f319 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 4fa1efb1-1488-48f4-a6ec-9b4787e01277] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:30.809054 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-03ae5b9d-dbe9-4885-ae13-b13440e3f319 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:30.809511 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-03ae5b9d-dbe9-4885-ae13-b13440e3f319 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:30.810671 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-03ae5b9d-dbe9-4885-ae13-b13440e3f319 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:30.812053 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-03ae5b9d-dbe9-4885-ae13-b13440e3f319 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:30.991261 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-03ae5b9d-dbe9-4885-ae13-b13440e3f319 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:46:31.006789 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-03ae5b9d-dbe9-4885-ae13-b13440e3f319 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277" status: 200 len: 1521 microversion: 2.1 time: 0.214096 Jul 19 15:46:31.007894 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 75/181] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:46:30 2022] GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277 => generated 1521 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:46:32.030510 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-e4414187-d6bf-4f34-aae4-8f60f9ce80d5 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:32.031242 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-e4414187-d6bf-4f34-aae4-8f60f9ce80d5 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 4fa1efb1-1488-48f4-a6ec-9b4787e01277] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:32.039987 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-e4414187-d6bf-4f34-aae4-8f60f9ce80d5 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:32.040943 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-e4414187-d6bf-4f34-aae4-8f60f9ce80d5 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:32.041781 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-e4414187-d6bf-4f34-aae4-8f60f9ce80d5 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:32.042222 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-e4414187-d6bf-4f34-aae4-8f60f9ce80d5 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:32.270645 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-e4414187-d6bf-4f34-aae4-8f60f9ce80d5 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:46:32.278882 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-e4414187-d6bf-4f34-aae4-8f60f9ce80d5 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277" status: 200 len: 1521 microversion: 2.1 time: 0.255619 Jul 19 15:46:32.279449 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 107/182] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:46:32 2022] GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277 => generated 1521 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:46:33.298109 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-c4ae6002-17a5-43a3-8c18-22776e436b9d tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:33.299531 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-c4ae6002-17a5-43a3-8c18-22776e436b9d tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 4fa1efb1-1488-48f4-a6ec-9b4787e01277] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:33.301682 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG dbcounter [-] [129519] Writing DB stats nova_api:SELECT=34 {{(pid=129519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:46:33.307360 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-c4ae6002-17a5-43a3-8c18-22776e436b9d tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:33.307709 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-c4ae6002-17a5-43a3-8c18-22776e436b9d tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:33.308601 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-c4ae6002-17a5-43a3-8c18-22776e436b9d tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:33.309110 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-c4ae6002-17a5-43a3-8c18-22776e436b9d tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:33.464620 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-c4ae6002-17a5-43a3-8c18-22776e436b9d tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:46:33.473907 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-c4ae6002-17a5-43a3-8c18-22776e436b9d tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277" status: 200 len: 1521 microversion: 2.1 time: 0.181302 Jul 19 15:46:33.474670 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 76/183] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:46:33 2022] GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277 => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:46:34.492347 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-7e45e6e1-50e7-4ba5-bd3d-71ea88790405 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:34.492970 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-7e45e6e1-50e7-4ba5-bd3d-71ea88790405 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 4fa1efb1-1488-48f4-a6ec-9b4787e01277] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:34.518763 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-7e45e6e1-50e7-4ba5-bd3d-71ea88790405 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:34.519431 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-7e45e6e1-50e7-4ba5-bd3d-71ea88790405 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:34.520939 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-7e45e6e1-50e7-4ba5-bd3d-71ea88790405 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:34.521531 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-7e45e6e1-50e7-4ba5-bd3d-71ea88790405 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:34.798414 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-7e45e6e1-50e7-4ba5-bd3d-71ea88790405 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:46:34.807079 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-7e45e6e1-50e7-4ba5-bd3d-71ea88790405 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277" status: 200 len: 1521 microversion: 2.1 time: 0.318490 Jul 19 15:46:34.808859 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 108/184] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:46:34 2022] GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277 => generated 1521 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:46:35.832920 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-9b683038-130b-4e78-a0b1-71de82ecc081 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:35.834432 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-9b683038-130b-4e78-a0b1-71de82ecc081 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 4fa1efb1-1488-48f4-a6ec-9b4787e01277] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:35.848525 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-9b683038-130b-4e78-a0b1-71de82ecc081 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:35.849319 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-9b683038-130b-4e78-a0b1-71de82ecc081 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:35.850849 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-9b683038-130b-4e78-a0b1-71de82ecc081 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:35.851676 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-9b683038-130b-4e78-a0b1-71de82ecc081 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:36.055537 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-9b683038-130b-4e78-a0b1-71de82ecc081 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:46:36.076598 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-9b683038-130b-4e78-a0b1-71de82ecc081 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277" status: 200 len: 1521 microversion: 2.1 time: 0.253744 Jul 19 15:46:36.079062 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 77/185] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:46:35 2022] GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277 => generated 1521 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:46:37.098596 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-dc3e195e-46fb-42be-87e2-ff1f3a173692 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:37.099352 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-dc3e195e-46fb-42be-87e2-ff1f3a173692 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 4fa1efb1-1488-48f4-a6ec-9b4787e01277] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:37.113007 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-dc3e195e-46fb-42be-87e2-ff1f3a173692 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:37.113597 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-dc3e195e-46fb-42be-87e2-ff1f3a173692 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:37.114533 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-dc3e195e-46fb-42be-87e2-ff1f3a173692 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:37.115172 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-dc3e195e-46fb-42be-87e2-ff1f3a173692 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:37.371729 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-dc3e195e-46fb-42be-87e2-ff1f3a173692 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:46:37.380141 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-dc3e195e-46fb-42be-87e2-ff1f3a173692 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277" status: 200 len: 1521 microversion: 2.1 time: 0.287644 Jul 19 15:46:37.381438 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 109/186] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:46:37 2022] GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277 => generated 1521 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:46:38.397783 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-a23aa759-694f-41fa-b5c0-e5ff206d3e9d tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:38.399151 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-a23aa759-694f-41fa-b5c0-e5ff206d3e9d tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 4fa1efb1-1488-48f4-a6ec-9b4787e01277] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:38.408340 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-a23aa759-694f-41fa-b5c0-e5ff206d3e9d tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:38.408958 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-a23aa759-694f-41fa-b5c0-e5ff206d3e9d tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:38.410718 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-a23aa759-694f-41fa-b5c0-e5ff206d3e9d tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:38.411297 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-a23aa759-694f-41fa-b5c0-e5ff206d3e9d tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:38.694240 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-a23aa759-694f-41fa-b5c0-e5ff206d3e9d tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:46:38.704938 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-a23aa759-694f-41fa-b5c0-e5ff206d3e9d tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277" status: 200 len: 1521 microversion: 2.1 time: 0.311563 Jul 19 15:46:38.706029 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 78/187] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:46:38 2022] GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277 => generated 1521 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:46:38.857333 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-06c5b8f3-7f09-4f4f-b997-76f4f3483fc5 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Action: 'create', calling method: .version_select at 0x7fb8a64cfa60>, body: {"keypair": {"name": "tempest-keypair-1462932047", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMzs3sg4tPoC2IziXdo2dPtAiFCc9JGRevtGSPGyFho349ifb8pXWEH2yJhcuXoL+4FHgXUxToOr+j8Cw5pDaiYFsqq1CKa1I/3O35lxRpu1yAGP3uPSc+/dxYqkZ3BVrg=="}} {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:46:38.886241 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG dbcounter [-] [129520] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=129520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:46:38.905453 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.quota [None req-06c5b8f3-7f09-4f4f-b997-76f4f3483fc5 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Getting quotas for project e11e234f713b40cd8772372c2316dd28. Resources: {'key_pairs'} {{(pid=129520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 15:46:38.910891 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.quota [None req-06c5b8f3-7f09-4f4f-b997-76f4f3483fc5 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Getting quotas for user d9c75043813844d79fd0764132dfe4dd and project e11e234f713b40cd8772372c2316dd28. Resources: {'key_pairs'} {{(pid=129520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 15:46:38.956282 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-06c5b8f3-7f09-4f4f-b997-76f4f3483fc5 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.283322 Jul 19 15:46:38.957039 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 110/188] 10.222.0.64 () {60 vars in 1158 bytes} [Tue Jul 19 15:46:38 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:46:39.722691 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-484f8ee9-991b-4d91-b683-f2956dc92ae9 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:39.723299 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-484f8ee9-991b-4d91-b683-f2956dc92ae9 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 4fa1efb1-1488-48f4-a6ec-9b4787e01277] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:39.738383 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-484f8ee9-991b-4d91-b683-f2956dc92ae9 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:39.738841 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-484f8ee9-991b-4d91-b683-f2956dc92ae9 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:39.739608 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-484f8ee9-991b-4d91-b683-f2956dc92ae9 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:39.740044 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-484f8ee9-991b-4d91-b683-f2956dc92ae9 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:40.020484 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-484f8ee9-991b-4d91-b683-f2956dc92ae9 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:46:40.028334 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-484f8ee9-991b-4d91-b683-f2956dc92ae9 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277" status: 200 len: 1521 microversion: 2.1 time: 0.309446 Jul 19 15:46:40.028999 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 79/189] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:46:39 2022] GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277 => generated 1521 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:46:40.657516 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-86b2484d-e6cb-4ce4-9fba-dc33652f229e tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-137521377", "imageRef": "15012099-fe38-45ac-bd33-d884a5ba65f2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7719a9e3-d30d-4797-868c-2dbb1911ec7c"}], "security_groups": [{"name": "tempest-securitygroup--1602816980"}], "key_name": "tempest-keypair-1462932047", "user_data": "}} {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:46:40.785348 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.network.neutron [None req-86b2484d-e6cb-4ce4-9fba-dc33652f229e tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] validate_networks() for [('7719a9e3-d30d-4797-868c-2dbb1911ec7c', None, None, None, None, None)] {{(pid=129520) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 15:46:41.048356 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-d53ba3c1-23b0-4df6-95a0-1bc9bcab79ad tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:41.049673 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-d53ba3c1-23b0-4df6-95a0-1bc9bcab79ad tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 4fa1efb1-1488-48f4-a6ec-9b4787e01277] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:41.056696 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-d53ba3c1-23b0-4df6-95a0-1bc9bcab79ad tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:41.057473 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-d53ba3c1-23b0-4df6-95a0-1bc9bcab79ad tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:41.058585 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-d53ba3c1-23b0-4df6-95a0-1bc9bcab79ad tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:41.059497 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-d53ba3c1-23b0-4df6-95a0-1bc9bcab79ad tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:41.229051 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-d53ba3c1-23b0-4df6-95a0-1bc9bcab79ad tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:46:41.243048 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-d53ba3c1-23b0-4df6-95a0-1bc9bcab79ad tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277" status: 200 len: 1521 microversion: 2.1 time: 0.199410 Jul 19 15:46:41.243930 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 80/190] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:46:41 2022] GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277 => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:46:41.264394 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.virt.hardware [None req-86b2484d-e6cb-4ce4-9fba-dc33652f229e tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Flavor limits 0:0:0 {{(pid=129520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 15:46:41.265217 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.virt.hardware [None req-86b2484d-e6cb-4ce4-9fba-dc33652f229e tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Image limits 0:0:0 {{(pid=129520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 15:46:41.265764 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.virt.hardware [None req-86b2484d-e6cb-4ce4-9fba-dc33652f229e tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Flavor pref 0:0:0 {{(pid=129520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 15:46:41.266418 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.virt.hardware [None req-86b2484d-e6cb-4ce4-9fba-dc33652f229e tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Image pref 0:0:0 {{(pid=129520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 15:46:41.266999 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.virt.hardware [None req-86b2484d-e6cb-4ce4-9fba-dc33652f229e tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 15:46:41.276863 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-86b2484d-e6cb-4ce4-9fba-dc33652f229e tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:41.277316 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-86b2484d-e6cb-4ce4-9fba-dc33652f229e tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:41.278109 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-86b2484d-e6cb-4ce4-9fba-dc33652f229e tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:41.278571 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-86b2484d-e6cb-4ce4-9fba-dc33652f229e tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:41.297907 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.quota [None req-86b2484d-e6cb-4ce4-9fba-dc33652f229e tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Getting quotas for project e11e234f713b40cd8772372c2316dd28. Resources: {'ram', 'instances', 'cores'} {{(pid=129520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 15:46:41.302643 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.quota [None req-86b2484d-e6cb-4ce4-9fba-dc33652f229e tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Getting quotas for user d9c75043813844d79fd0764132dfe4dd and project e11e234f713b40cd8772372c2316dd28. Resources: {'ram', 'instances', 'cores'} {{(pid=129520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 15:46:41.316475 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-86b2484d-e6cb-4ce4-9fba-dc33652f229e tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Going to run 1 instances... {{(pid=129520) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 15:46:41.319006 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-86b2484d-e6cb-4ce4-9fba-dc33652f229e tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 343ae383-5bfd-4c70-8926-a800fcee3519] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='15012099-fe38-45ac-bd33-d884a5ba65f2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 15:46:41.387033 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-86b2484d-e6cb-4ce4-9fba-dc33652f229e tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.734517 Jul 19 15:46:41.388977 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 111/191] 10.222.0.64 () {60 vars in 1146 bytes} [Tue Jul 19 15:46:40 2022] POST /compute/v2.1/servers => generated 402 bytes in 737 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 15:46:41.407663 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-10973577-6d4b-449b-93ad-e9dde4e6b21a tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:41.408372 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-10973577-6d4b-449b-93ad-e9dde4e6b21a tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 343ae383-5bfd-4c70-8926-a800fcee3519] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:41.514412 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-10973577-6d4b-449b-93ad-e9dde4e6b21a tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c75043813844d79fd0764132dfe4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e234f713b40cd8772372c2316dd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:46:41.531606 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-10973577-6d4b-449b-93ad-e9dde4e6b21a tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519" status: 200 len: 1237 microversion: 2.1 time: 0.135926 Jul 19 15:46:41.532205 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 81/192] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:46:41 2022] GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519 => generated 1237 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:46:42.261071 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-daea4e45-da23-466a-b1ad-5bd9fbdea97f tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:42.262791 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-daea4e45-da23-466a-b1ad-5bd9fbdea97f tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 4fa1efb1-1488-48f4-a6ec-9b4787e01277] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:42.270637 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-daea4e45-da23-466a-b1ad-5bd9fbdea97f tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:42.271086 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-daea4e45-da23-466a-b1ad-5bd9fbdea97f tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:42.271859 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-daea4e45-da23-466a-b1ad-5bd9fbdea97f tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:42.272353 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-daea4e45-da23-466a-b1ad-5bd9fbdea97f tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:42.423284 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-daea4e45-da23-466a-b1ad-5bd9fbdea97f tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:46:42.431033 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-daea4e45-da23-466a-b1ad-5bd9fbdea97f tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277" status: 200 len: 1521 microversion: 2.1 time: 0.173933 Jul 19 15:46:42.431611 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 112/193] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:46:42 2022] GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:46:42.549890 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-de6a7c86-2abb-4589-8125-3400ba855f9c tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:42.550631 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-de6a7c86-2abb-4589-8125-3400ba855f9c tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 343ae383-5bfd-4c70-8926-a800fcee3519] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:42.557109 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-de6a7c86-2abb-4589-8125-3400ba855f9c tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:42.557554 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-de6a7c86-2abb-4589-8125-3400ba855f9c tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:42.558320 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-de6a7c86-2abb-4589-8125-3400ba855f9c tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:42.558781 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-de6a7c86-2abb-4589-8125-3400ba855f9c tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:42.648788 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-de6a7c86-2abb-4589-8125-3400ba855f9c tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c75043813844d79fd0764132dfe4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e234f713b40cd8772372c2316dd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:46:42.652278 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG dbcounter [-] [129519] Writing DB stats nova_cell1:SELECT=100 {{(pid=129519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:46:42.658093 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-de6a7c86-2abb-4589-8125-3400ba855f9c tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519" status: 200 len: 1289 microversion: 2.1 time: 0.112204 Jul 19 15:46:42.659085 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 82/194] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:46:42 2022] GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519 => generated 1289 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:46:43.449353 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-ec1c104e-a2ca-4025-9b48-66980819bd82 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:43.450163 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-ec1c104e-a2ca-4025-9b48-66980819bd82 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 4fa1efb1-1488-48f4-a6ec-9b4787e01277] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:43.459421 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-ec1c104e-a2ca-4025-9b48-66980819bd82 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:43.470214 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-ec1c104e-a2ca-4025-9b48-66980819bd82 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:43.472694 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-ec1c104e-a2ca-4025-9b48-66980819bd82 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:43.473086 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-ec1c104e-a2ca-4025-9b48-66980819bd82 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:43.684312 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-a00d468e-89a0-4b1d-8f94-c7d0f2e4df94 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:43.685425 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-a00d468e-89a0-4b1d-8f94-c7d0f2e4df94 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 343ae383-5bfd-4c70-8926-a800fcee3519] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:43.696814 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-a00d468e-89a0-4b1d-8f94-c7d0f2e4df94 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:43.697442 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-a00d468e-89a0-4b1d-8f94-c7d0f2e4df94 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:43.698488 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-a00d468e-89a0-4b1d-8f94-c7d0f2e4df94 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:43.699157 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-a00d468e-89a0-4b1d-8f94-c7d0f2e4df94 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:43.718767 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-ec1c104e-a2ca-4025-9b48-66980819bd82 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:46:43.727995 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-ec1c104e-a2ca-4025-9b48-66980819bd82 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277" status: 200 len: 1521 microversion: 2.1 time: 0.283536 Jul 19 15:46:43.739729 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 113/195] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:46:43 2022] GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277 => generated 1521 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:46:44.009304 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-a00d468e-89a0-4b1d-8f94-c7d0f2e4df94 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c75043813844d79fd0764132dfe4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e234f713b40cd8772372c2316dd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:46:44.018703 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-a00d468e-89a0-4b1d-8f94-c7d0f2e4df94 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519" status: 200 len: 1363 microversion: 2.1 time: 0.344081 Jul 19 15:46:44.019296 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 83/196] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:46:43 2022] GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519 => generated 1363 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:46:44.475938 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [req-a6b988e0-1b85-4f32-8e2e-1b3ca9425960 req-38a39105-5727-4930-8c09-dee096093b9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "343ae383-5bfd-4c70-8926-a800fcee3519", "tag": "a70da232-0d1f-4d96-ac45-c34ad79c41f8"}]} {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:46:44.508602 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [req-a6b988e0-1b85-4f32-8e2e-1b3ca9425960 req-38a39105-5727-4930-8c09-dee096093b9e service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:44.509046 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [req-a6b988e0-1b85-4f32-8e2e-1b3ca9425960 req-38a39105-5727-4930-8c09-dee096093b9e service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:44.525478 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.compute.server_external_events [req-a6b988e0-1b85-4f32-8e2e-1b3ca9425960 req-38a39105-5727-4930-8c09-dee096093b9e service nova] Creating event network-changed:a70da232-0d1f-4d96-ac45-c34ad79c41f8 for instance 343ae383-5bfd-4c70-8926-a800fcee3519 on hv-cinder-84902 Jul 19 15:46:44.543731 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [req-a6b988e0-1b85-4f32-8e2e-1b3ca9425960 req-38a39105-5727-4930-8c09-dee096093b9e service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079823 Jul 19 15:46:44.544697 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 114/197] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Jul 19 15:46:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:46:44.747099 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-e788a74e-3f32-48dd-b4cc-a2e8caaa8560 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:44.749127 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-e788a74e-3f32-48dd-b4cc-a2e8caaa8560 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 4fa1efb1-1488-48f4-a6ec-9b4787e01277] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:44.756299 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-e788a74e-3f32-48dd-b4cc-a2e8caaa8560 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:44.756796 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-e788a74e-3f32-48dd-b4cc-a2e8caaa8560 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:44.757956 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-e788a74e-3f32-48dd-b4cc-a2e8caaa8560 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:44.758600 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-e788a74e-3f32-48dd-b4cc-a2e8caaa8560 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:45.010157 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-e788a74e-3f32-48dd-b4cc-a2e8caaa8560 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:46:45.020193 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-e788a74e-3f32-48dd-b4cc-a2e8caaa8560 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277" status: 200 len: 1521 microversion: 2.1 time: 0.278125 Jul 19 15:46:45.020950 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 84/198] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:46:44 2022] GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277 => generated 1521 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:46:45.040929 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-baed799e-857f-465c-84d7-09a09b6b1968 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:45.042712 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-baed799e-857f-465c-84d7-09a09b6b1968 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 343ae383-5bfd-4c70-8926-a800fcee3519] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:45.051472 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-baed799e-857f-465c-84d7-09a09b6b1968 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:45.051864 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-baed799e-857f-465c-84d7-09a09b6b1968 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:45.052639 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-baed799e-857f-465c-84d7-09a09b6b1968 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:45.053074 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-baed799e-857f-465c-84d7-09a09b6b1968 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:45.218977 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-baed799e-857f-465c-84d7-09a09b6b1968 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c75043813844d79fd0764132dfe4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e234f713b40cd8772372c2316dd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:46:45.234242 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-baed799e-857f-465c-84d7-09a09b6b1968 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519" status: 200 len: 1363 microversion: 2.1 time: 0.200633 Jul 19 15:46:45.241500 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 115/199] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:46:45 2022] GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519 => generated 1363 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:46:46.037398 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-8cb2d8f1-42ad-4fba-a3dd-387856b2654b tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:46.038000 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-8cb2d8f1-42ad-4fba-a3dd-387856b2654b tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 4fa1efb1-1488-48f4-a6ec-9b4787e01277] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:46.052520 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-8cb2d8f1-42ad-4fba-a3dd-387856b2654b tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:46.052520 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-8cb2d8f1-42ad-4fba-a3dd-387856b2654b tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:46.052520 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-8cb2d8f1-42ad-4fba-a3dd-387856b2654b tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:46.052520 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-8cb2d8f1-42ad-4fba-a3dd-387856b2654b tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:46.179960 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-8cb2d8f1-42ad-4fba-a3dd-387856b2654b tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:46:46.188166 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-8cb2d8f1-42ad-4fba-a3dd-387856b2654b tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277" status: 200 len: 1521 microversion: 2.1 time: 0.154855 Jul 19 15:46:46.188740 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 85/200] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:46:46 2022] GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:46:46.250030 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-efeffe21-304f-48b7-b97d-200fd6aa7dc7 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:46.250669 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-efeffe21-304f-48b7-b97d-200fd6aa7dc7 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 343ae383-5bfd-4c70-8926-a800fcee3519] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:46.257094 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-efeffe21-304f-48b7-b97d-200fd6aa7dc7 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:46.257577 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-efeffe21-304f-48b7-b97d-200fd6aa7dc7 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:46.258687 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-efeffe21-304f-48b7-b97d-200fd6aa7dc7 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:46.259003 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-efeffe21-304f-48b7-b97d-200fd6aa7dc7 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:46.419249 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-efeffe21-304f-48b7-b97d-200fd6aa7dc7 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c75043813844d79fd0764132dfe4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e234f713b40cd8772372c2316dd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:46:46.429931 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-efeffe21-304f-48b7-b97d-200fd6aa7dc7 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519" status: 200 len: 1363 microversion: 2.1 time: 0.183747 Jul 19 15:46:46.430445 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 116/201] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:46:46 2022] GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519 => generated 1363 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:46:47.204530 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-eade16a3-31ab-4af1-b1e3-9e9e407d4dfc tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:47.205755 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-eade16a3-31ab-4af1-b1e3-9e9e407d4dfc tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 4fa1efb1-1488-48f4-a6ec-9b4787e01277] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:47.212413 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-eade16a3-31ab-4af1-b1e3-9e9e407d4dfc tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:47.212881 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-eade16a3-31ab-4af1-b1e3-9e9e407d4dfc tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:47.213666 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-eade16a3-31ab-4af1-b1e3-9e9e407d4dfc tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:47.214331 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-eade16a3-31ab-4af1-b1e3-9e9e407d4dfc tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:47.355926 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-eade16a3-31ab-4af1-b1e3-9e9e407d4dfc tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:46:47.365711 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-eade16a3-31ab-4af1-b1e3-9e9e407d4dfc tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277" status: 200 len: 1521 microversion: 2.1 time: 0.165184 Jul 19 15:46:47.366418 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 86/202] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:46:47 2022] GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:46:47.449385 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-5e51a093-5ecc-4bb7-830c-e62e10d586b8 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:47.449385 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-5e51a093-5ecc-4bb7-830c-e62e10d586b8 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 343ae383-5bfd-4c70-8926-a800fcee3519] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:47.457745 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-5e51a093-5ecc-4bb7-830c-e62e10d586b8 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:47.458239 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-5e51a093-5ecc-4bb7-830c-e62e10d586b8 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:47.459168 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-5e51a093-5ecc-4bb7-830c-e62e10d586b8 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:47.459780 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-5e51a093-5ecc-4bb7-830c-e62e10d586b8 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:47.660440 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-5e51a093-5ecc-4bb7-830c-e62e10d586b8 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c75043813844d79fd0764132dfe4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e234f713b40cd8772372c2316dd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:46:47.668240 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-5e51a093-5ecc-4bb7-830c-e62e10d586b8 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519" status: 200 len: 1363 microversion: 2.1 time: 0.224743 Jul 19 15:46:47.668877 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 117/203] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:46:47 2022] GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519 => generated 1363 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:46:48.382571 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-861e06a2-d5fe-4a0d-a53c-ec37ddb3ff4d tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:48.383184 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-861e06a2-d5fe-4a0d-a53c-ec37ddb3ff4d tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 4fa1efb1-1488-48f4-a6ec-9b4787e01277] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:48.390246 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-861e06a2-d5fe-4a0d-a53c-ec37ddb3ff4d tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:48.390843 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-861e06a2-d5fe-4a0d-a53c-ec37ddb3ff4d tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:48.391682 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-861e06a2-d5fe-4a0d-a53c-ec37ddb3ff4d tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:48.392181 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-861e06a2-d5fe-4a0d-a53c-ec37ddb3ff4d tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:48.560626 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-861e06a2-d5fe-4a0d-a53c-ec37ddb3ff4d tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:46:48.568998 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-861e06a2-d5fe-4a0d-a53c-ec37ddb3ff4d tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277" status: 200 len: 1521 microversion: 2.1 time: 0.190217 Jul 19 15:46:48.569564 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 87/204] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:46:48 2022] GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277 => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:46:48.685302 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-92b5964f-d3fd-4e38-8fcd-c0967a587ca2 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:48.686566 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-92b5964f-d3fd-4e38-8fcd-c0967a587ca2 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 343ae383-5bfd-4c70-8926-a800fcee3519] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:48.693071 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-92b5964f-d3fd-4e38-8fcd-c0967a587ca2 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:48.693579 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-92b5964f-d3fd-4e38-8fcd-c0967a587ca2 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:48.694510 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-92b5964f-d3fd-4e38-8fcd-c0967a587ca2 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:48.694999 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-92b5964f-d3fd-4e38-8fcd-c0967a587ca2 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:48.850836 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-92b5964f-d3fd-4e38-8fcd-c0967a587ca2 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c75043813844d79fd0764132dfe4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e234f713b40cd8772372c2316dd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:46:48.860177 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-92b5964f-d3fd-4e38-8fcd-c0967a587ca2 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519" status: 200 len: 1363 microversion: 2.1 time: 0.178610 Jul 19 15:46:48.861252 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 118/205] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:46:48 2022] GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519 => generated 1363 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:46:49.586180 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-316a57ac-84b6-4e58-b27f-f3b4575f0445 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:49.586806 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-316a57ac-84b6-4e58-b27f-f3b4575f0445 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 4fa1efb1-1488-48f4-a6ec-9b4787e01277] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:49.594133 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-316a57ac-84b6-4e58-b27f-f3b4575f0445 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:49.594669 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-316a57ac-84b6-4e58-b27f-f3b4575f0445 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:49.595558 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-316a57ac-84b6-4e58-b27f-f3b4575f0445 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:49.596034 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-316a57ac-84b6-4e58-b27f-f3b4575f0445 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:49.735355 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-316a57ac-84b6-4e58-b27f-f3b4575f0445 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:46:49.743542 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-316a57ac-84b6-4e58-b27f-f3b4575f0445 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277" status: 200 len: 1521 microversion: 2.1 time: 0.161027 Jul 19 15:46:49.744413 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 88/206] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:46:49 2022] GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277 => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:46:49.877610 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-02673bfb-b28d-4024-b4c5-4df4892192fa tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:49.878225 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-02673bfb-b28d-4024-b4c5-4df4892192fa tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 343ae383-5bfd-4c70-8926-a800fcee3519] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:49.884906 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-02673bfb-b28d-4024-b4c5-4df4892192fa tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:49.885353 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-02673bfb-b28d-4024-b4c5-4df4892192fa tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:49.886121 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-02673bfb-b28d-4024-b4c5-4df4892192fa tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:49.886592 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-02673bfb-b28d-4024-b4c5-4df4892192fa tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:50.053101 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-02673bfb-b28d-4024-b4c5-4df4892192fa tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c75043813844d79fd0764132dfe4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e234f713b40cd8772372c2316dd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:46:50.061188 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-02673bfb-b28d-4024-b4c5-4df4892192fa tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519" status: 200 len: 1363 microversion: 2.1 time: 0.187805 Jul 19 15:46:50.062296 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 119/207] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:46:49 2022] GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519 => generated 1363 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:46:50.201149 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-b335216b-228e-4d71-bb1f-9581261fbe60 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-599355856", "imageRef": "15012099-fe38-45ac-bd33-d884a5ba65f2", "flavorRef": "452"}} {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:46:50.763355 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-8cb4a34a-af44-4b4a-8f16-10217d7a8cca tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:50.764647 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-8cb4a34a-af44-4b4a-8f16-10217d7a8cca tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 4fa1efb1-1488-48f4-a6ec-9b4787e01277] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:50.771367 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-8cb4a34a-af44-4b4a-8f16-10217d7a8cca tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:50.771639 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-8cb4a34a-af44-4b4a-8f16-10217d7a8cca tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:50.772342 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-8cb4a34a-af44-4b4a-8f16-10217d7a8cca tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:50.772959 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-8cb4a34a-af44-4b4a-8f16-10217d7a8cca tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:50.915527 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-8cb4a34a-af44-4b4a-8f16-10217d7a8cca tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:46:50.924106 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-8cb4a34a-af44-4b4a-8f16-10217d7a8cca tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277" status: 200 len: 1521 microversion: 2.1 time: 0.164569 Jul 19 15:46:50.924674 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 120/208] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:46:50 2022] GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:46:51.078072 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-1a6d66f5-7dd6-4238-86fa-65affedf3c99 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:51.078619 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-1a6d66f5-7dd6-4238-86fa-65affedf3c99 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 343ae383-5bfd-4c70-8926-a800fcee3519] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:51.084427 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-1a6d66f5-7dd6-4238-86fa-65affedf3c99 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:51.084919 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-1a6d66f5-7dd6-4238-86fa-65affedf3c99 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:51.085690 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-1a6d66f5-7dd6-4238-86fa-65affedf3c99 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:51.086116 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-1a6d66f5-7dd6-4238-86fa-65affedf3c99 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:51.105330 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG dbcounter [-] [129520] Writing DB stats nova_cell1:SELECT=100 {{(pid=129520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:46:51.221269 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-1a6d66f5-7dd6-4238-86fa-65affedf3c99 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c75043813844d79fd0764132dfe4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e234f713b40cd8772372c2316dd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:46:51.229543 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-1a6d66f5-7dd6-4238-86fa-65affedf3c99 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519" status: 200 len: 1363 microversion: 2.1 time: 0.155334 Jul 19 15:46:51.230534 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 121/209] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:46:51 2022] GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:46:51.520312 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG dbcounter [-] [129519] Writing DB stats nova_cell0:SELECT=2 {{(pid=129519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:46:51.942621 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-bbd1a7d1-7443-490f-af0b-93cbf70e6d05 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:51.943404 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-bbd1a7d1-7443-490f-af0b-93cbf70e6d05 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 4fa1efb1-1488-48f4-a6ec-9b4787e01277] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:51.945595 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG dbcounter [-] [129520] Writing DB stats nova_cell0:SELECT=2 {{(pid=129520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:46:51.946546 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG dbcounter [-] [129520] Writing DB stats nova_cell0:SELECT=10 {{(pid=129520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:46:51.953889 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-bbd1a7d1-7443-490f-af0b-93cbf70e6d05 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:51.954381 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-bbd1a7d1-7443-490f-af0b-93cbf70e6d05 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:51.955315 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-bbd1a7d1-7443-490f-af0b-93cbf70e6d05 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:51.955780 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-bbd1a7d1-7443-490f-af0b-93cbf70e6d05 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:52.101181 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-bbd1a7d1-7443-490f-af0b-93cbf70e6d05 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:46:52.112817 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-bbd1a7d1-7443-490f-af0b-93cbf70e6d05 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277" status: 200 len: 1521 microversion: 2.1 time: 0.174829 Jul 19 15:46:52.113398 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 122/210] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:46:51 2022] GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277 => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:46:52.247398 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-0945521c-506b-4e41-86d0-130f6a4134e8 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:52.247906 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-0945521c-506b-4e41-86d0-130f6a4134e8 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 343ae383-5bfd-4c70-8926-a800fcee3519] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:52.253904 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-0945521c-506b-4e41-86d0-130f6a4134e8 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:52.254345 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-0945521c-506b-4e41-86d0-130f6a4134e8 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:52.255121 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-0945521c-506b-4e41-86d0-130f6a4134e8 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:52.255543 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-0945521c-506b-4e41-86d0-130f6a4134e8 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:52.394402 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-0945521c-506b-4e41-86d0-130f6a4134e8 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c75043813844d79fd0764132dfe4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e234f713b40cd8772372c2316dd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:46:52.401795 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-0945521c-506b-4e41-86d0-130f6a4134e8 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519" status: 200 len: 1363 microversion: 2.1 time: 0.158368 Jul 19 15:46:52.402406 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 123/211] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:46:52 2022] GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:46:53.047033 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.network.neutron [None req-b335216b-228e-4d71-bb1f-9581261fbe60 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] validate_networks() for None {{(pid=129519) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 15:46:53.131328 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-86a97097-b17e-4a5a-a059-5e851053134e tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:53.131328 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-86a97097-b17e-4a5a-a059-5e851053134e tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 4fa1efb1-1488-48f4-a6ec-9b4787e01277] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:53.137757 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-86a97097-b17e-4a5a-a059-5e851053134e tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:53.138286 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-86a97097-b17e-4a5a-a059-5e851053134e tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:53.139217 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-86a97097-b17e-4a5a-a059-5e851053134e tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:53.139740 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-86a97097-b17e-4a5a-a059-5e851053134e tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:53.286666 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-86a97097-b17e-4a5a-a059-5e851053134e tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:46:53.294503 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-86a97097-b17e-4a5a-a059-5e851053134e tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277" status: 200 len: 1521 microversion: 2.1 time: 0.167721 Jul 19 15:46:53.295101 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 124/212] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:46:53 2022] GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277 => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:46:53.419885 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-9df4239f-d383-4fe5-acd1-c5909d45562c tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:53.420513 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-9df4239f-d383-4fe5-acd1-c5909d45562c tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 343ae383-5bfd-4c70-8926-a800fcee3519] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:53.427103 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-9df4239f-d383-4fe5-acd1-c5909d45562c tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:53.427547 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-9df4239f-d383-4fe5-acd1-c5909d45562c tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:53.428318 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-9df4239f-d383-4fe5-acd1-c5909d45562c tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:53.428809 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-9df4239f-d383-4fe5-acd1-c5909d45562c tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:53.561709 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.virt.hardware [None req-b335216b-228e-4d71-bb1f-9581261fbe60 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Flavor limits 0:0:0 {{(pid=129519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 15:46:53.562683 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.virt.hardware [None req-b335216b-228e-4d71-bb1f-9581261fbe60 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Image limits 0:0:0 {{(pid=129519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 15:46:53.563246 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.virt.hardware [None req-b335216b-228e-4d71-bb1f-9581261fbe60 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Flavor pref 0:0:0 {{(pid=129519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 15:46:53.563658 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.virt.hardware [None req-b335216b-228e-4d71-bb1f-9581261fbe60 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Image pref 0:0:0 {{(pid=129519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 15:46:53.564066 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.virt.hardware [None req-b335216b-228e-4d71-bb1f-9581261fbe60 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 15:46:53.564789 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-9df4239f-d383-4fe5-acd1-c5909d45562c tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c75043813844d79fd0764132dfe4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e234f713b40cd8772372c2316dd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:46:53.572227 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-9df4239f-d383-4fe5-acd1-c5909d45562c tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519" status: 200 len: 1363 microversion: 2.1 time: 0.156186 Jul 19 15:46:53.572797 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 125/213] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:46:53 2022] GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:46:53.573141 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-b335216b-228e-4d71-bb1f-9581261fbe60 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:53.573602 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-b335216b-228e-4d71-bb1f-9581261fbe60 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:53.574435 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-b335216b-228e-4d71-bb1f-9581261fbe60 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:53.574869 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-b335216b-228e-4d71-bb1f-9581261fbe60 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:53.592264 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.quota [None req-b335216b-228e-4d71-bb1f-9581261fbe60 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Getting quotas for project 537dfdfbaae043f38cd4300e1b030682. Resources: {'ram', 'instances', 'cores'} {{(pid=129519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 15:46:53.596873 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.quota [None req-b335216b-228e-4d71-bb1f-9581261fbe60 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Getting quotas for user fdc32c284f7e498e9d53402e73e76c88 and project 537dfdfbaae043f38cd4300e1b030682. Resources: {'ram', 'instances', 'cores'} {{(pid=129519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 15:46:53.610305 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-b335216b-228e-4d71-bb1f-9581261fbe60 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Going to run 1 instances... {{(pid=129519) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 15:46:53.613119 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-b335216b-228e-4d71-bb1f-9581261fbe60 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] [instance: 36b522b7-9f73-4cbf-b09d-57abc62dc90e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='15012099-fe38-45ac-bd33-d884a5ba65f2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 15:46:53.661553 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-b335216b-228e-4d71-bb1f-9581261fbe60 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.463650 Jul 19 15:46:53.662746 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 89/214] 10.222.0.64 () {60 vars in 1146 bytes} [Tue Jul 19 15:46:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 3466 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 15:46:53.673225 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-a93f77ba-b86a-4c74-9aeb-e3d625cf27cd tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:53.673949 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-a93f77ba-b86a-4c74-9aeb-e3d625cf27cd tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] [instance: 36b522b7-9f73-4cbf-b09d-57abc62dc90e] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:53.736172 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-a93f77ba-b86a-4c74-9aeb-e3d625cf27cd tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc32c284f7e498e9d53402e73e76c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537dfdfbaae043f38cd4300e1b030682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:46:53.743696 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-a93f77ba-b86a-4c74-9aeb-e3d625cf27cd tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] 10.222.0.64 "GET /compute/v2.1/servers/36b522b7-9f73-4cbf-b09d-57abc62dc90e" status: 200 len: 1214 microversion: 2.1 time: 0.075052 Jul 19 15:46:53.744261 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 126/215] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:46:53 2022] GET /compute/v2.1/servers/36b522b7-9f73-4cbf-b09d-57abc62dc90e => generated 1214 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:46:54.312573 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-56a5de90-c972-48cd-9aba-d6bde8161906 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:54.313129 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-56a5de90-c972-48cd-9aba-d6bde8161906 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 4fa1efb1-1488-48f4-a6ec-9b4787e01277] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:54.319539 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-56a5de90-c972-48cd-9aba-d6bde8161906 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:54.319983 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-56a5de90-c972-48cd-9aba-d6bde8161906 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:54.320730 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-56a5de90-c972-48cd-9aba-d6bde8161906 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:54.321160 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-56a5de90-c972-48cd-9aba-d6bde8161906 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:54.455186 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-56a5de90-c972-48cd-9aba-d6bde8161906 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:46:54.462569 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-56a5de90-c972-48cd-9aba-d6bde8161906 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277" status: 200 len: 1521 microversion: 2.1 time: 0.154568 Jul 19 15:46:54.463130 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 90/216] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:46:54 2022] GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:46:54.589622 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-bd2f791d-2583-4d25-9bf8-37bd64c36471 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:54.590273 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-bd2f791d-2583-4d25-9bf8-37bd64c36471 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 343ae383-5bfd-4c70-8926-a800fcee3519] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:54.596294 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-bd2f791d-2583-4d25-9bf8-37bd64c36471 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:54.596731 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-bd2f791d-2583-4d25-9bf8-37bd64c36471 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:54.597476 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-bd2f791d-2583-4d25-9bf8-37bd64c36471 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:54.597906 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-bd2f791d-2583-4d25-9bf8-37bd64c36471 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:54.729939 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-bd2f791d-2583-4d25-9bf8-37bd64c36471 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c75043813844d79fd0764132dfe4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e234f713b40cd8772372c2316dd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:46:54.738213 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-bd2f791d-2583-4d25-9bf8-37bd64c36471 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519" status: 200 len: 1363 microversion: 2.1 time: 0.152521 Jul 19 15:46:54.738805 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 127/217] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:46:54 2022] GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:46:54.760916 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-020a9d7a-06e0-4a63-89e4-287ee71c06c4 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:54.761517 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-020a9d7a-06e0-4a63-89e4-287ee71c06c4 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] [instance: 36b522b7-9f73-4cbf-b09d-57abc62dc90e] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:54.767932 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-020a9d7a-06e0-4a63-89e4-287ee71c06c4 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:54.768347 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-020a9d7a-06e0-4a63-89e4-287ee71c06c4 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:54.769094 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-020a9d7a-06e0-4a63-89e4-287ee71c06c4 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:54.769519 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-020a9d7a-06e0-4a63-89e4-287ee71c06c4 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:54.833332 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-020a9d7a-06e0-4a63-89e4-287ee71c06c4 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc32c284f7e498e9d53402e73e76c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537dfdfbaae043f38cd4300e1b030682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:46:54.840732 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-020a9d7a-06e0-4a63-89e4-287ee71c06c4 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] 10.222.0.64 "GET /compute/v2.1/servers/36b522b7-9f73-4cbf-b09d-57abc62dc90e" status: 200 len: 1218 microversion: 2.1 time: 0.083590 Jul 19 15:46:54.841225 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 91/218] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:46:54 2022] GET /compute/v2.1/servers/36b522b7-9f73-4cbf-b09d-57abc62dc90e => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:46:55.415341 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-5f030765-4789-45cc-8403-31eb1cbb040c tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:55.415832 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-5f030765-4789-45cc-8403-31eb1cbb040c tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:55.422020 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-5f030765-4789-45cc-8403-31eb1cbb040c tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:55.422516 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-5f030765-4789-45cc-8403-31eb1cbb040c tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:55.423275 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-5f030765-4789-45cc-8403-31eb1cbb040c tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:55.423708 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-5f030765-4789-45cc-8403-31eb1cbb040c tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:55.479615 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-affc33f1-dbeb-4fe9-9572-1a48ac1bd815 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:55.480157 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-affc33f1-dbeb-4fe9-9572-1a48ac1bd815 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 4fa1efb1-1488-48f4-a6ec-9b4787e01277] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:55.486885 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-affc33f1-dbeb-4fe9-9572-1a48ac1bd815 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:55.487533 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-affc33f1-dbeb-4fe9-9572-1a48ac1bd815 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:55.488345 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-affc33f1-dbeb-4fe9-9572-1a48ac1bd815 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:55.488783 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-affc33f1-dbeb-4fe9-9572-1a48ac1bd815 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:55.582495 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-5f030765-4789-45cc-8403-31eb1cbb040c tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b/ips" status: 200 len: 152 microversion: 2.20 time: 0.171001 Jul 19 15:46:55.583084 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 128/219] 10.222.0.64 () {60 vars in 1288 bytes} [Tue Jul 19 15:46:55 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b/ips => generated 152 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 15:46:55.623830 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-affc33f1-dbeb-4fe9-9572-1a48ac1bd815 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:46:55.631854 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-affc33f1-dbeb-4fe9-9572-1a48ac1bd815 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277" status: 200 len: 1521 microversion: 2.1 time: 0.156281 Jul 19 15:46:55.632429 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 92/220] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:46:55 2022] GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:46:55.756467 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-fda3043f-75b0-41f8-bc76-87960d5272db tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:55.757177 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-fda3043f-75b0-41f8-bc76-87960d5272db tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 343ae383-5bfd-4c70-8926-a800fcee3519] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:55.763728 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-fda3043f-75b0-41f8-bc76-87960d5272db tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:55.764178 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-fda3043f-75b0-41f8-bc76-87960d5272db tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:55.765706 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-fda3043f-75b0-41f8-bc76-87960d5272db tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:55.766214 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-fda3043f-75b0-41f8-bc76-87960d5272db tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:55.868946 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-8f72c763-1a2a-4477-81ee-38e8a9aa8fd5 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:55.869652 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-8f72c763-1a2a-4477-81ee-38e8a9aa8fd5 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] [instance: 36b522b7-9f73-4cbf-b09d-57abc62dc90e] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:55.878299 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-8f72c763-1a2a-4477-81ee-38e8a9aa8fd5 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:55.883448 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-8f72c763-1a2a-4477-81ee-38e8a9aa8fd5 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:55.884307 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-8f72c763-1a2a-4477-81ee-38e8a9aa8fd5 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:55.884747 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-8f72c763-1a2a-4477-81ee-38e8a9aa8fd5 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:55.926566 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-fda3043f-75b0-41f8-bc76-87960d5272db tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c75043813844d79fd0764132dfe4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e234f713b40cd8772372c2316dd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:46:55.934803 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-fda3043f-75b0-41f8-bc76-87960d5272db tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519" status: 200 len: 1363 microversion: 2.1 time: 0.182294 Jul 19 15:46:55.938391 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 129/221] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:46:55 2022] GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519 => generated 1363 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:46:55.961013 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-8f72c763-1a2a-4477-81ee-38e8a9aa8fd5 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc32c284f7e498e9d53402e73e76c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537dfdfbaae043f38cd4300e1b030682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:46:55.969122 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-8f72c763-1a2a-4477-81ee-38e8a9aa8fd5 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] 10.222.0.64 "GET /compute/v2.1/servers/36b522b7-9f73-4cbf-b09d-57abc62dc90e" status: 200 len: 1218 microversion: 2.1 time: 0.114659 Jul 19 15:46:55.969694 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 93/222] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:46:55 2022] GET /compute/v2.1/servers/36b522b7-9f73-4cbf-b09d-57abc62dc90e => generated 1218 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:46:56.650001 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-62910340-911d-43b0-aa40-5f57351bc5ed tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:56.650658 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-62910340-911d-43b0-aa40-5f57351bc5ed tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 4fa1efb1-1488-48f4-a6ec-9b4787e01277] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:56.657271 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-62910340-911d-43b0-aa40-5f57351bc5ed tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:56.657716 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-62910340-911d-43b0-aa40-5f57351bc5ed tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:56.658507 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-62910340-911d-43b0-aa40-5f57351bc5ed tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:56.658938 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-62910340-911d-43b0-aa40-5f57351bc5ed tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:56.791822 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-62910340-911d-43b0-aa40-5f57351bc5ed tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:46:56.799891 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-62910340-911d-43b0-aa40-5f57351bc5ed tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277" status: 200 len: 1521 microversion: 2.1 time: 0.154240 Jul 19 15:46:56.800442 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 130/223] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:46:56 2022] GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:46:56.951823 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-e2508be9-c91d-423e-a76e-d9570695c49e tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:56.952744 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-e2508be9-c91d-423e-a76e-d9570695c49e tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 343ae383-5bfd-4c70-8926-a800fcee3519] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:56.959992 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-e2508be9-c91d-423e-a76e-d9570695c49e tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:56.960445 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-e2508be9-c91d-423e-a76e-d9570695c49e tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:56.961313 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-e2508be9-c91d-423e-a76e-d9570695c49e tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:56.961849 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-e2508be9-c91d-423e-a76e-d9570695c49e tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:56.985740 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-4a394d64-73a6-446c-9478-93e561f21e38 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:56.986377 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-4a394d64-73a6-446c-9478-93e561f21e38 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] [instance: 36b522b7-9f73-4cbf-b09d-57abc62dc90e] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:56.992570 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-4a394d64-73a6-446c-9478-93e561f21e38 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:56.993247 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-4a394d64-73a6-446c-9478-93e561f21e38 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:56.994257 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-4a394d64-73a6-446c-9478-93e561f21e38 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:56.994789 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-4a394d64-73a6-446c-9478-93e561f21e38 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:57.067785 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-4a394d64-73a6-446c-9478-93e561f21e38 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc32c284f7e498e9d53402e73e76c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537dfdfbaae043f38cd4300e1b030682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:46:57.075479 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-4a394d64-73a6-446c-9478-93e561f21e38 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] 10.222.0.64 "GET /compute/v2.1/servers/36b522b7-9f73-4cbf-b09d-57abc62dc90e" status: 200 len: 1266 microversion: 2.1 time: 0.094357 Jul 19 15:46:57.076051 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 131/224] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:46:56 2022] GET /compute/v2.1/servers/36b522b7-9f73-4cbf-b09d-57abc62dc90e => generated 1266 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:46:57.113390 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-e2508be9-c91d-423e-a76e-d9570695c49e tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c75043813844d79fd0764132dfe4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e234f713b40cd8772372c2316dd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:46:57.120844 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-e2508be9-c91d-423e-a76e-d9570695c49e tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519" status: 200 len: 1363 microversion: 2.1 time: 0.173079 Jul 19 15:46:57.121415 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 94/225] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:46:56 2022] GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519 => generated 1363 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:46:57.817144 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-9cb52508-e90e-4d49-b2de-2dd4431a23d6 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:57.817755 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-9cb52508-e90e-4d49-b2de-2dd4431a23d6 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 4fa1efb1-1488-48f4-a6ec-9b4787e01277] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:57.823811 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-9cb52508-e90e-4d49-b2de-2dd4431a23d6 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:57.824259 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-9cb52508-e90e-4d49-b2de-2dd4431a23d6 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:57.825017 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-9cb52508-e90e-4d49-b2de-2dd4431a23d6 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:57.825453 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-9cb52508-e90e-4d49-b2de-2dd4431a23d6 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:57.958994 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-9cb52508-e90e-4d49-b2de-2dd4431a23d6 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:46:57.966578 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-9cb52508-e90e-4d49-b2de-2dd4431a23d6 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277" status: 200 len: 1521 microversion: 2.1 time: 0.153209 Jul 19 15:46:57.967150 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 132/226] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:46:57 2022] GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277 => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:46:58.092797 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-5e55f634-49c4-45c0-878e-c461ea6384ed tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:58.093963 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-5e55f634-49c4-45c0-878e-c461ea6384ed tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] [instance: 36b522b7-9f73-4cbf-b09d-57abc62dc90e] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:58.100565 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-5e55f634-49c4-45c0-878e-c461ea6384ed tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:58.101014 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-5e55f634-49c4-45c0-878e-c461ea6384ed tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:58.101773 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-5e55f634-49c4-45c0-878e-c461ea6384ed tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:58.102208 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-5e55f634-49c4-45c0-878e-c461ea6384ed tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:58.137446 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-d72fa6fc-45ed-425b-92d0-8e5cdda39c06 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:58.138047 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-d72fa6fc-45ed-425b-92d0-8e5cdda39c06 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 343ae383-5bfd-4c70-8926-a800fcee3519] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:58.144765 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-d72fa6fc-45ed-425b-92d0-8e5cdda39c06 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:58.145216 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-d72fa6fc-45ed-425b-92d0-8e5cdda39c06 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:58.145978 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-d72fa6fc-45ed-425b-92d0-8e5cdda39c06 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:58.146436 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-d72fa6fc-45ed-425b-92d0-8e5cdda39c06 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:58.164259 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-5e55f634-49c4-45c0-878e-c461ea6384ed tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc32c284f7e498e9d53402e73e76c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537dfdfbaae043f38cd4300e1b030682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:46:58.171943 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-5e55f634-49c4-45c0-878e-c461ea6384ed tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] 10.222.0.64 "GET /compute/v2.1/servers/36b522b7-9f73-4cbf-b09d-57abc62dc90e" status: 200 len: 1266 microversion: 2.1 time: 0.082832 Jul 19 15:46:58.172761 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 95/227] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:46:58 2022] GET /compute/v2.1/servers/36b522b7-9f73-4cbf-b09d-57abc62dc90e => generated 1266 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:46:58.280910 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-d72fa6fc-45ed-425b-92d0-8e5cdda39c06 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c75043813844d79fd0764132dfe4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e234f713b40cd8772372c2316dd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:46:58.290654 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-d72fa6fc-45ed-425b-92d0-8e5cdda39c06 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519" status: 200 len: 1363 microversion: 2.1 time: 0.156715 Jul 19 15:46:58.291299 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 133/228] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:46:58 2022] GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:46:58.983529 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-4609c4d7-320a-4c2c-9b05-1b8a20d8062c tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:58.984275 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-4609c4d7-320a-4c2c-9b05-1b8a20d8062c tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 4fa1efb1-1488-48f4-a6ec-9b4787e01277] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:58.990591 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-4609c4d7-320a-4c2c-9b05-1b8a20d8062c tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:58.991040 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-4609c4d7-320a-4c2c-9b05-1b8a20d8062c tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:58.991808 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-4609c4d7-320a-4c2c-9b05-1b8a20d8062c tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:58.992233 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-4609c4d7-320a-4c2c-9b05-1b8a20d8062c tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:59.128849 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-4609c4d7-320a-4c2c-9b05-1b8a20d8062c tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:46:59.136326 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-4609c4d7-320a-4c2c-9b05-1b8a20d8062c tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277" status: 200 len: 1521 microversion: 2.1 time: 0.156742 Jul 19 15:46:59.136887 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 96/229] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:46:58 2022] GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277 => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:46:59.161788 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-910e81a9-7818-4b63-aed4-fa079e66ecda tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:46:59.162320 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-910e81a9-7818-4b63-aed4-fa079e66ecda tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:59.168301 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-910e81a9-7818-4b63-aed4-fa079e66ecda tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:59.168747 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-910e81a9-7818-4b63-aed4-fa079e66ecda tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:59.169499 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-910e81a9-7818-4b63-aed4-fa079e66ecda tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:59.169929 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-910e81a9-7818-4b63-aed4-fa079e66ecda tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:59.190786 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-6a4d0055-5d42-427d-99a8-9ccb26d56f4d tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:59.191497 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-6a4d0055-5d42-427d-99a8-9ccb26d56f4d tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] [instance: 36b522b7-9f73-4cbf-b09d-57abc62dc90e] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:59.198276 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-6a4d0055-5d42-427d-99a8-9ccb26d56f4d tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:59.198493 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.objects.instance [None req-910e81a9-7818-4b63-aed4-fa079e66ecda tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lazy-loading 'flavor' on Instance uuid 3eeb4a51-a06c-4faf-9a63-bf3658ca773b {{(pid=129520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 15:46:59.198757 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-6a4d0055-5d42-427d-99a8-9ccb26d56f4d tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:59.199539 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-6a4d0055-5d42-427d-99a8-9ccb26d56f4d tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:59.199970 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-6a4d0055-5d42-427d-99a8-9ccb26d56f4d tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:59.263363 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-6a4d0055-5d42-427d-99a8-9ccb26d56f4d tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc32c284f7e498e9d53402e73e76c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537dfdfbaae043f38cd4300e1b030682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:46:59.272179 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-6a4d0055-5d42-427d-99a8-9ccb26d56f4d tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] 10.222.0.64 "GET /compute/v2.1/servers/36b522b7-9f73-4cbf-b09d-57abc62dc90e" status: 200 len: 1266 microversion: 2.1 time: 0.086771 Jul 19 15:46:59.272762 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 97/230] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:46:59 2022] GET /compute/v2.1/servers/36b522b7-9f73-4cbf-b09d-57abc62dc90e => generated 1266 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:46:59.308221 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-5a148136-f6e9-4356-94eb-8c1111252db2 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:59.308830 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-5a148136-f6e9-4356-94eb-8c1111252db2 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 343ae383-5bfd-4c70-8926-a800fcee3519] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:59.315767 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-5a148136-f6e9-4356-94eb-8c1111252db2 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:59.316243 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-5a148136-f6e9-4356-94eb-8c1111252db2 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:59.317003 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-5a148136-f6e9-4356-94eb-8c1111252db2 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:59.317435 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-5a148136-f6e9-4356-94eb-8c1111252db2 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:59.461206 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-5a148136-f6e9-4356-94eb-8c1111252db2 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c75043813844d79fd0764132dfe4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e234f713b40cd8772372c2316dd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:46:59.469818 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-5a148136-f6e9-4356-94eb-8c1111252db2 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519" status: 200 len: 1363 microversion: 2.1 time: 0.165225 Jul 19 15:46:59.472525 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-910e81a9-7818-4b63-aed4-fa079e66ecda tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "POST /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b/action" status: 202 len: 0 microversion: 2.20 time: 0.314385 Jul 19 15:46:59.473589 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 134/231] 10.222.0.64 () {62 vars in 1318 bytes} [Tue Jul 19 15:46:59 2022] POST /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b/action => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 19 15:46:59.479193 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 98/232] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:46:59 2022] GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519 => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:46:59.489051 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-20495269-b1ad-4fb2-a39c-cf3fe92afe80 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:46:59.489792 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-20495269-b1ad-4fb2-a39c-cf3fe92afe80 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:46:59.496175 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-20495269-b1ad-4fb2-a39c-cf3fe92afe80 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:59.496618 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-20495269-b1ad-4fb2-a39c-cf3fe92afe80 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:59.497376 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-20495269-b1ad-4fb2-a39c-cf3fe92afe80 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:46:59.497804 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-20495269-b1ad-4fb2-a39c-cf3fe92afe80 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:46:59.634551 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-20495269-b1ad-4fb2-a39c-cf3fe92afe80 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:46:59.643385 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-20495269-b1ad-4fb2-a39c-cf3fe92afe80 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:46:59.644908 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-20495269-b1ad-4fb2-a39c-cf3fe92afe80 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:46:59.646063 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-20495269-b1ad-4fb2-a39c-cf3fe92afe80 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 200 len: 1723 microversion: 2.20 time: 0.161232 Jul 19 15:46:59.646666 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 135/233] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:46:59 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 15:47:00.153351 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-1dc94087-dac5-4ca1-a49d-6d1a946c4281 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:00.153954 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-1dc94087-dac5-4ca1-a49d-6d1a946c4281 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 4fa1efb1-1488-48f4-a6ec-9b4787e01277] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:00.161051 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-1dc94087-dac5-4ca1-a49d-6d1a946c4281 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:00.161505 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-1dc94087-dac5-4ca1-a49d-6d1a946c4281 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:00.162260 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-1dc94087-dac5-4ca1-a49d-6d1a946c4281 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:00.162726 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-1dc94087-dac5-4ca1-a49d-6d1a946c4281 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:00.289464 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-29cc5c65-4799-43bd-a559-37d20934323a tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:00.289992 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-29cc5c65-4799-43bd-a559-37d20934323a tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] [instance: 36b522b7-9f73-4cbf-b09d-57abc62dc90e] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:00.296584 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-29cc5c65-4799-43bd-a559-37d20934323a tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:00.297210 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-29cc5c65-4799-43bd-a559-37d20934323a tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:00.297985 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-29cc5c65-4799-43bd-a559-37d20934323a tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:00.298490 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-29cc5c65-4799-43bd-a559-37d20934323a tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:00.302577 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-1dc94087-dac5-4ca1-a49d-6d1a946c4281 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:00.314027 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-1dc94087-dac5-4ca1-a49d-6d1a946c4281 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277" status: 200 len: 1521 microversion: 2.1 time: 0.164300 Jul 19 15:47:00.314692 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 99/234] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:00 2022] GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:47:00.365262 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-29cc5c65-4799-43bd-a559-37d20934323a tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc32c284f7e498e9d53402e73e76c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537dfdfbaae043f38cd4300e1b030682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:00.372536 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-29cc5c65-4799-43bd-a559-37d20934323a tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] 10.222.0.64 "GET /compute/v2.1/servers/36b522b7-9f73-4cbf-b09d-57abc62dc90e" status: 200 len: 1266 microversion: 2.1 time: 0.087433 Jul 19 15:47:00.373193 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 136/235] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:00 2022] GET /compute/v2.1/servers/36b522b7-9f73-4cbf-b09d-57abc62dc90e => generated 1266 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:47:00.487014 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-ef8a1185-ef7b-4b28-848c-caac8ae7966e tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:00.487645 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-ef8a1185-ef7b-4b28-848c-caac8ae7966e tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 343ae383-5bfd-4c70-8926-a800fcee3519] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:00.495204 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-ef8a1185-ef7b-4b28-848c-caac8ae7966e tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:00.495654 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-ef8a1185-ef7b-4b28-848c-caac8ae7966e tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:00.496411 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-ef8a1185-ef7b-4b28-848c-caac8ae7966e tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:00.496840 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-ef8a1185-ef7b-4b28-848c-caac8ae7966e tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:00.501366 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG dbcounter [-] [129519] Writing DB stats nova_cell1:SELECT=100 {{(pid=129519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:00.626250 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-ef8a1185-ef7b-4b28-848c-caac8ae7966e tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c75043813844d79fd0764132dfe4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e234f713b40cd8772372c2316dd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:00.633773 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-ef8a1185-ef7b-4b28-848c-caac8ae7966e tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519" status: 200 len: 1363 microversion: 2.1 time: 0.151265 Jul 19 15:47:00.634336 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 100/236] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:00 2022] GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519 => generated 1363 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:47:00.665030 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-abaaaa83-72f1-423b-a65e-918221009feb tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:00.665636 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-abaaaa83-72f1-423b-a65e-918221009feb tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:00.671824 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-abaaaa83-72f1-423b-a65e-918221009feb tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:00.672276 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-abaaaa83-72f1-423b-a65e-918221009feb tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:00.673074 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-abaaaa83-72f1-423b-a65e-918221009feb tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:00.673513 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-abaaaa83-72f1-423b-a65e-918221009feb tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:00.692434 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG dbcounter [-] [129520] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:00.805382 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-abaaaa83-72f1-423b-a65e-918221009feb tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:00.813300 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-abaaaa83-72f1-423b-a65e-918221009feb tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:00.814857 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-abaaaa83-72f1-423b-a65e-918221009feb tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:00.816046 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-abaaaa83-72f1-423b-a65e-918221009feb tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 200 len: 1723 microversion: 2.20 time: 0.155091 Jul 19 15:47:00.816605 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 137/237] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:47:00 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:47:01.332601 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-93cde920-8eef-45be-8098-17ef49d45fa3 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:01.333205 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-93cde920-8eef-45be-8098-17ef49d45fa3 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 4fa1efb1-1488-48f4-a6ec-9b4787e01277] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:01.339721 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-93cde920-8eef-45be-8098-17ef49d45fa3 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:01.340170 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-93cde920-8eef-45be-8098-17ef49d45fa3 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:01.340925 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-93cde920-8eef-45be-8098-17ef49d45fa3 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:01.341359 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-93cde920-8eef-45be-8098-17ef49d45fa3 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:01.392177 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-79726eb8-f24d-4a8c-afe6-7b9c462e27b4 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:01.392915 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-79726eb8-f24d-4a8c-afe6-7b9c462e27b4 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] [instance: 36b522b7-9f73-4cbf-b09d-57abc62dc90e] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:01.399486 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-79726eb8-f24d-4a8c-afe6-7b9c462e27b4 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:01.399933 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-79726eb8-f24d-4a8c-afe6-7b9c462e27b4 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:01.400694 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-79726eb8-f24d-4a8c-afe6-7b9c462e27b4 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:01.401125 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-79726eb8-f24d-4a8c-afe6-7b9c462e27b4 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:01.465773 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-79726eb8-f24d-4a8c-afe6-7b9c462e27b4 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc32c284f7e498e9d53402e73e76c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537dfdfbaae043f38cd4300e1b030682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:01.473593 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-79726eb8-f24d-4a8c-afe6-7b9c462e27b4 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] 10.222.0.64 "GET /compute/v2.1/servers/36b522b7-9f73-4cbf-b09d-57abc62dc90e" status: 200 len: 1266 microversion: 2.1 time: 0.086938 Jul 19 15:47:01.474378 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 138/238] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:01 2022] GET /compute/v2.1/servers/36b522b7-9f73-4cbf-b09d-57abc62dc90e => generated 1266 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:47:01.479479 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-93cde920-8eef-45be-8098-17ef49d45fa3 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:01.487258 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-93cde920-8eef-45be-8098-17ef49d45fa3 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277" status: 200 len: 1521 microversion: 2.1 time: 0.160131 Jul 19 15:47:01.487827 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 101/239] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:01 2022] GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:47:01.650873 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-13e99822-68da-4cc2-bdd7-612049b2b9ee tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:01.651417 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-13e99822-68da-4cc2-bdd7-612049b2b9ee tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 343ae383-5bfd-4c70-8926-a800fcee3519] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:01.657537 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-13e99822-68da-4cc2-bdd7-612049b2b9ee tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:01.657984 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-13e99822-68da-4cc2-bdd7-612049b2b9ee tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:01.658782 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-13e99822-68da-4cc2-bdd7-612049b2b9ee tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:01.659224 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-13e99822-68da-4cc2-bdd7-612049b2b9ee tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:01.787031 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-13e99822-68da-4cc2-bdd7-612049b2b9ee tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c75043813844d79fd0764132dfe4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e234f713b40cd8772372c2316dd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:01.794433 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-13e99822-68da-4cc2-bdd7-612049b2b9ee tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519" status: 200 len: 1363 microversion: 2.1 time: 0.147436 Jul 19 15:47:01.794988 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 139/240] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:01 2022] GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519 => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:47:01.834209 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-f8bba010-60aa-47da-b398-e5899b9d2c68 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:01.834828 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-f8bba010-60aa-47da-b398-e5899b9d2c68 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:01.840828 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-f8bba010-60aa-47da-b398-e5899b9d2c68 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:01.841364 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-f8bba010-60aa-47da-b398-e5899b9d2c68 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:01.842022 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-f8bba010-60aa-47da-b398-e5899b9d2c68 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:01.842482 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-f8bba010-60aa-47da-b398-e5899b9d2c68 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:01.969588 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-f8bba010-60aa-47da-b398-e5899b9d2c68 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:01.977536 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-f8bba010-60aa-47da-b398-e5899b9d2c68 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:01.979083 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-f8bba010-60aa-47da-b398-e5899b9d2c68 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:01.980229 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-f8bba010-60aa-47da-b398-e5899b9d2c68 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 200 len: 1723 microversion: 2.20 time: 0.149877 Jul 19 15:47:01.980780 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 102/241] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:47:01 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:47:02.491886 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-bbff41eb-54fd-4cfd-a0cf-eab799a35158 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:02.492393 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-bbff41eb-54fd-4cfd-a0cf-eab799a35158 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] [instance: 36b522b7-9f73-4cbf-b09d-57abc62dc90e] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:02.498574 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-bbff41eb-54fd-4cfd-a0cf-eab799a35158 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:02.499023 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-bbff41eb-54fd-4cfd-a0cf-eab799a35158 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:02.499823 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-bbff41eb-54fd-4cfd-a0cf-eab799a35158 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:02.500495 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-bbff41eb-54fd-4cfd-a0cf-eab799a35158 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:02.504378 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-d691a873-0fd9-475f-8825-02166364f7f7 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:02.505064 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-d691a873-0fd9-475f-8825-02166364f7f7 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 4fa1efb1-1488-48f4-a6ec-9b4787e01277] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:02.511742 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-d691a873-0fd9-475f-8825-02166364f7f7 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:02.512198 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-d691a873-0fd9-475f-8825-02166364f7f7 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:02.512966 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-d691a873-0fd9-475f-8825-02166364f7f7 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:02.513402 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-d691a873-0fd9-475f-8825-02166364f7f7 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:02.563435 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-bbff41eb-54fd-4cfd-a0cf-eab799a35158 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc32c284f7e498e9d53402e73e76c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537dfdfbaae043f38cd4300e1b030682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:02.571001 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-bbff41eb-54fd-4cfd-a0cf-eab799a35158 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] 10.222.0.64 "GET /compute/v2.1/servers/36b522b7-9f73-4cbf-b09d-57abc62dc90e" status: 200 len: 1266 microversion: 2.1 time: 0.083034 Jul 19 15:47:02.571561 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 140/242] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:02 2022] GET /compute/v2.1/servers/36b522b7-9f73-4cbf-b09d-57abc62dc90e => generated 1266 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:47:02.648392 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-d691a873-0fd9-475f-8825-02166364f7f7 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:02.656453 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-d691a873-0fd9-475f-8825-02166364f7f7 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277" status: 200 len: 1521 microversion: 2.1 time: 0.155532 Jul 19 15:47:02.657026 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 103/243] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:02 2022] GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:47:02.810925 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-c15c46ec-820c-424c-99bd-7fd5eccc013c tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:02.811436 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-c15c46ec-820c-424c-99bd-7fd5eccc013c tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 343ae383-5bfd-4c70-8926-a800fcee3519] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:02.817477 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-c15c46ec-820c-424c-99bd-7fd5eccc013c tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:02.817924 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-c15c46ec-820c-424c-99bd-7fd5eccc013c tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:02.818721 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-c15c46ec-820c-424c-99bd-7fd5eccc013c tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:02.819158 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-c15c46ec-820c-424c-99bd-7fd5eccc013c tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:02.951808 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-c15c46ec-820c-424c-99bd-7fd5eccc013c tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c75043813844d79fd0764132dfe4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e234f713b40cd8772372c2316dd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:02.960230 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-c15c46ec-820c-424c-99bd-7fd5eccc013c tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519" status: 200 len: 1363 microversion: 2.1 time: 0.153351 Jul 19 15:47:02.960796 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 141/244] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:02 2022] GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:47:02.999027 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-da74dabd-1040-485a-a7b4-e0fc248412a1 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:03.000207 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-da74dabd-1040-485a-a7b4-e0fc248412a1 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:03.006346 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-da74dabd-1040-485a-a7b4-e0fc248412a1 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:03.006962 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-da74dabd-1040-485a-a7b4-e0fc248412a1 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:03.007743 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-da74dabd-1040-485a-a7b4-e0fc248412a1 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:03.008169 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-da74dabd-1040-485a-a7b4-e0fc248412a1 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:03.137218 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-da74dabd-1040-485a-a7b4-e0fc248412a1 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:03.145803 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-da74dabd-1040-485a-a7b4-e0fc248412a1 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:03.147333 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-da74dabd-1040-485a-a7b4-e0fc248412a1 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:03.148475 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-da74dabd-1040-485a-a7b4-e0fc248412a1 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 200 len: 1723 microversion: 2.20 time: 0.153321 Jul 19 15:47:03.149035 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 104/245] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:47:02 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 1723 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:47:03.588283 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-2b9ef00a-2e69-4e66-aa1b-c2ba2afff929 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:03.588890 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-2b9ef00a-2e69-4e66-aa1b-c2ba2afff929 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] [instance: 36b522b7-9f73-4cbf-b09d-57abc62dc90e] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:03.595565 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-2b9ef00a-2e69-4e66-aa1b-c2ba2afff929 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:03.596011 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-2b9ef00a-2e69-4e66-aa1b-c2ba2afff929 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:03.596764 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-2b9ef00a-2e69-4e66-aa1b-c2ba2afff929 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:03.597192 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-2b9ef00a-2e69-4e66-aa1b-c2ba2afff929 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:03.658025 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-2b9ef00a-2e69-4e66-aa1b-c2ba2afff929 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc32c284f7e498e9d53402e73e76c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537dfdfbaae043f38cd4300e1b030682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:03.665616 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-2b9ef00a-2e69-4e66-aa1b-c2ba2afff929 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] 10.222.0.64 "GET /compute/v2.1/servers/36b522b7-9f73-4cbf-b09d-57abc62dc90e" status: 200 len: 1266 microversion: 2.1 time: 0.081180 Jul 19 15:47:03.666173 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 142/246] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:03 2022] GET /compute/v2.1/servers/36b522b7-9f73-4cbf-b09d-57abc62dc90e => generated 1266 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:47:03.679474 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-3e385fdd-3a00-4a6f-bbd8-890208c41adb tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:03.680180 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-3e385fdd-3a00-4a6f-bbd8-890208c41adb tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 4fa1efb1-1488-48f4-a6ec-9b4787e01277] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:03.682281 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG dbcounter [-] [129519] Writing DB stats nova_cell0:SELECT=2 {{(pid=129519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:03.683232 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG dbcounter [-] [129519] Writing DB stats nova_cell0:SELECT=6 {{(pid=129519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:03.683714 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG dbcounter [-] [129519] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=3 {{(pid=129519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:03.690631 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-3e385fdd-3a00-4a6f-bbd8-890208c41adb tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:03.691074 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-3e385fdd-3a00-4a6f-bbd8-890208c41adb tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:03.691834 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-3e385fdd-3a00-4a6f-bbd8-890208c41adb tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:03.692260 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-3e385fdd-3a00-4a6f-bbd8-890208c41adb tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:03.820347 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-3e385fdd-3a00-4a6f-bbd8-890208c41adb tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:03.828387 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-3e385fdd-3a00-4a6f-bbd8-890208c41adb tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277" status: 200 len: 1521 microversion: 2.1 time: 0.152758 Jul 19 15:47:03.828966 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 105/247] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:03 2022] GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:47:03.976998 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-8c8e76a2-5dda-43ef-a42a-0a6b951edcc6 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:03.977535 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-8c8e76a2-5dda-43ef-a42a-0a6b951edcc6 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 343ae383-5bfd-4c70-8926-a800fcee3519] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:03.979448 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG dbcounter [-] [129520] Writing DB stats nova_cell0:SELECT=2 {{(pid=129520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:03.985109 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-8c8e76a2-5dda-43ef-a42a-0a6b951edcc6 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:03.985559 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-8c8e76a2-5dda-43ef-a42a-0a6b951edcc6 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:03.986323 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-8c8e76a2-5dda-43ef-a42a-0a6b951edcc6 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:03.986794 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-8c8e76a2-5dda-43ef-a42a-0a6b951edcc6 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:04.118029 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-8c8e76a2-5dda-43ef-a42a-0a6b951edcc6 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c75043813844d79fd0764132dfe4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e234f713b40cd8772372c2316dd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:04.126029 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-8c8e76a2-5dda-43ef-a42a-0a6b951edcc6 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519" status: 200 len: 1363 microversion: 2.1 time: 0.152985 Jul 19 15:47:04.126631 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 143/248] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:03 2022] GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:47:04.167462 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-44ae04eb-bc39-4c5a-ae09-67ffdba8b42a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:04.168056 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-44ae04eb-bc39-4c5a-ae09-67ffdba8b42a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:04.174262 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-44ae04eb-bc39-4c5a-ae09-67ffdba8b42a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:04.174738 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-44ae04eb-bc39-4c5a-ae09-67ffdba8b42a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:04.175478 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-44ae04eb-bc39-4c5a-ae09-67ffdba8b42a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:04.175925 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-44ae04eb-bc39-4c5a-ae09-67ffdba8b42a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:04.307941 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-44ae04eb-bc39-4c5a-ae09-67ffdba8b42a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:04.316103 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-44ae04eb-bc39-4c5a-ae09-67ffdba8b42a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:04.317615 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-44ae04eb-bc39-4c5a-ae09-67ffdba8b42a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:04.318789 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-44ae04eb-bc39-4c5a-ae09-67ffdba8b42a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 200 len: 1723 microversion: 2.20 time: 0.155195 Jul 19 15:47:04.319348 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 106/249] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:47:04 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 15:47:04.682985 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-3c3c40f6-a45c-4de2-80d0-7a2b23201475 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:04.683590 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-3c3c40f6-a45c-4de2-80d0-7a2b23201475 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] [instance: 36b522b7-9f73-4cbf-b09d-57abc62dc90e] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:04.690398 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-3c3c40f6-a45c-4de2-80d0-7a2b23201475 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:04.690842 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-3c3c40f6-a45c-4de2-80d0-7a2b23201475 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:04.691605 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-3c3c40f6-a45c-4de2-80d0-7a2b23201475 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:04.692028 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-3c3c40f6-a45c-4de2-80d0-7a2b23201475 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:04.757255 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-3c3c40f6-a45c-4de2-80d0-7a2b23201475 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc32c284f7e498e9d53402e73e76c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537dfdfbaae043f38cd4300e1b030682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:04.764615 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-3c3c40f6-a45c-4de2-80d0-7a2b23201475 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] 10.222.0.64 "GET /compute/v2.1/servers/36b522b7-9f73-4cbf-b09d-57abc62dc90e" status: 200 len: 1266 microversion: 2.1 time: 0.085733 Jul 19 15:47:04.765793 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 144/250] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:04 2022] GET /compute/v2.1/servers/36b522b7-9f73-4cbf-b09d-57abc62dc90e => generated 1266 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:47:04.844830 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-3b184fe2-cd04-4b3e-8a7d-9069dec13d96 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:04.845435 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-3b184fe2-cd04-4b3e-8a7d-9069dec13d96 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 4fa1efb1-1488-48f4-a6ec-9b4787e01277] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:04.852024 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-3b184fe2-cd04-4b3e-8a7d-9069dec13d96 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:04.852474 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-3b184fe2-cd04-4b3e-8a7d-9069dec13d96 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:04.853231 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-3b184fe2-cd04-4b3e-8a7d-9069dec13d96 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:04.853667 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-3b184fe2-cd04-4b3e-8a7d-9069dec13d96 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:04.981734 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-3b184fe2-cd04-4b3e-8a7d-9069dec13d96 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:04.989897 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-3b184fe2-cd04-4b3e-8a7d-9069dec13d96 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277" status: 200 len: 1521 microversion: 2.1 time: 0.148883 Jul 19 15:47:04.990492 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 107/251] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:04 2022] GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:47:05.143151 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-d482618f-f0c0-46cd-96ab-776be743ea89 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:05.143759 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-d482618f-f0c0-46cd-96ab-776be743ea89 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 343ae383-5bfd-4c70-8926-a800fcee3519] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:05.149772 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-d482618f-f0c0-46cd-96ab-776be743ea89 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:05.150528 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-d482618f-f0c0-46cd-96ab-776be743ea89 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:05.151514 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-d482618f-f0c0-46cd-96ab-776be743ea89 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:05.152162 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-d482618f-f0c0-46cd-96ab-776be743ea89 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:05.286899 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-d482618f-f0c0-46cd-96ab-776be743ea89 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c75043813844d79fd0764132dfe4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e234f713b40cd8772372c2316dd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:05.294384 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-d482618f-f0c0-46cd-96ab-776be743ea89 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519" status: 200 len: 1363 microversion: 2.1 time: 0.155278 Jul 19 15:47:05.295287 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 145/252] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:05 2022] GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:47:05.336931 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-05e17b7f-4ff8-4480-b570-fe9fcca73e53 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:05.337540 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-05e17b7f-4ff8-4480-b570-fe9fcca73e53 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:05.343523 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-05e17b7f-4ff8-4480-b570-fe9fcca73e53 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:05.343973 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-05e17b7f-4ff8-4480-b570-fe9fcca73e53 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:05.345246 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-05e17b7f-4ff8-4480-b570-fe9fcca73e53 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:05.345678 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-05e17b7f-4ff8-4480-b570-fe9fcca73e53 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:05.479661 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-05e17b7f-4ff8-4480-b570-fe9fcca73e53 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:05.488500 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-05e17b7f-4ff8-4480-b570-fe9fcca73e53 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:05.490022 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-05e17b7f-4ff8-4480-b570-fe9fcca73e53 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:05.491201 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-05e17b7f-4ff8-4480-b570-fe9fcca73e53 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 200 len: 1723 microversion: 2.20 time: 0.158205 Jul 19 15:47:05.491762 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 108/253] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:47:05 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:47:05.781841 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-229e7a1f-d527-4d47-aca9-c302fbb08b91 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:05.783116 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-229e7a1f-d527-4d47-aca9-c302fbb08b91 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] [instance: 36b522b7-9f73-4cbf-b09d-57abc62dc90e] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:05.784997 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG dbcounter [-] [129520] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=129520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:05.790602 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-229e7a1f-d527-4d47-aca9-c302fbb08b91 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:05.791057 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-229e7a1f-d527-4d47-aca9-c302fbb08b91 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:05.791855 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-229e7a1f-d527-4d47-aca9-c302fbb08b91 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:05.792292 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-229e7a1f-d527-4d47-aca9-c302fbb08b91 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:05.854106 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-229e7a1f-d527-4d47-aca9-c302fbb08b91 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc32c284f7e498e9d53402e73e76c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537dfdfbaae043f38cd4300e1b030682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:05.861739 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-229e7a1f-d527-4d47-aca9-c302fbb08b91 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] 10.222.0.64 "GET /compute/v2.1/servers/36b522b7-9f73-4cbf-b09d-57abc62dc90e" status: 200 len: 1274 microversion: 2.1 time: 0.083689 Jul 19 15:47:05.862304 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 146/254] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:05 2022] GET /compute/v2.1/servers/36b522b7-9f73-4cbf-b09d-57abc62dc90e => generated 1274 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:47:06.008179 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-b1d10338-6186-4e4c-a994-222e67603d98 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:06.008697 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-b1d10338-6186-4e4c-a994-222e67603d98 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 4fa1efb1-1488-48f4-a6ec-9b4787e01277] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:06.014883 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-b1d10338-6186-4e4c-a994-222e67603d98 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:06.015328 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-b1d10338-6186-4e4c-a994-222e67603d98 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:06.016076 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-b1d10338-6186-4e4c-a994-222e67603d98 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:06.017260 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-b1d10338-6186-4e4c-a994-222e67603d98 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:06.311476 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-77a1fde2-8b8d-458d-af25-daad98200108 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:06.312177 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-77a1fde2-8b8d-458d-af25-daad98200108 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 343ae383-5bfd-4c70-8926-a800fcee3519] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:06.320254 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-77a1fde2-8b8d-458d-af25-daad98200108 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:06.320805 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-77a1fde2-8b8d-458d-af25-daad98200108 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:06.321642 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-77a1fde2-8b8d-458d-af25-daad98200108 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:06.322222 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-77a1fde2-8b8d-458d-af25-daad98200108 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:06.330829 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-b1d10338-6186-4e4c-a994-222e67603d98 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:06.339162 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-b1d10338-6186-4e4c-a994-222e67603d98 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277" status: 200 len: 1521 microversion: 2.1 time: 0.334715 Jul 19 15:47:06.339755 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 109/255] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:06 2022] GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277 => generated 1521 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:47:06.466653 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-77a1fde2-8b8d-458d-af25-daad98200108 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c75043813844d79fd0764132dfe4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e234f713b40cd8772372c2316dd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:06.476012 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-77a1fde2-8b8d-458d-af25-daad98200108 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519" status: 200 len: 1363 microversion: 2.1 time: 0.167785 Jul 19 15:47:06.485025 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 147/256] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:06 2022] GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519 => generated 1363 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:47:06.509254 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-da10e448-750e-41b5-93be-23bc2b19e3d9 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:06.509803 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-da10e448-750e-41b5-93be-23bc2b19e3d9 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:06.515835 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-da10e448-750e-41b5-93be-23bc2b19e3d9 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:06.516448 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-da10e448-750e-41b5-93be-23bc2b19e3d9 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:06.517152 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-da10e448-750e-41b5-93be-23bc2b19e3d9 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:06.517579 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-da10e448-750e-41b5-93be-23bc2b19e3d9 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:06.834050 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-da10e448-750e-41b5-93be-23bc2b19e3d9 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:06.845651 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-da10e448-750e-41b5-93be-23bc2b19e3d9 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:06.847536 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-da10e448-750e-41b5-93be-23bc2b19e3d9 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:06.848730 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-da10e448-750e-41b5-93be-23bc2b19e3d9 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 200 len: 1723 microversion: 2.20 time: 0.343647 Jul 19 15:47:06.849745 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 110/257] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:47:06 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 1723 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:47:06.879073 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-ae1c2d29-f94f-471a-acd2-783a6c59b26a tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:06.879684 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-ae1c2d29-f94f-471a-acd2-783a6c59b26a tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] [instance: 36b522b7-9f73-4cbf-b09d-57abc62dc90e] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:06.886235 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-ae1c2d29-f94f-471a-acd2-783a6c59b26a tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:06.886718 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-ae1c2d29-f94f-471a-acd2-783a6c59b26a tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:06.887495 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-ae1c2d29-f94f-471a-acd2-783a6c59b26a tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:06.888133 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-ae1c2d29-f94f-471a-acd2-783a6c59b26a tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:06.959476 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-ae1c2d29-f94f-471a-acd2-783a6c59b26a tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc32c284f7e498e9d53402e73e76c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537dfdfbaae043f38cd4300e1b030682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:06.967658 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-ae1c2d29-f94f-471a-acd2-783a6c59b26a tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] 10.222.0.64 "GET /compute/v2.1/servers/36b522b7-9f73-4cbf-b09d-57abc62dc90e" status: 200 len: 1272 microversion: 2.1 time: 0.092525 Jul 19 15:47:06.968228 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 148/258] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:06 2022] GET /compute/v2.1/servers/36b522b7-9f73-4cbf-b09d-57abc62dc90e => generated 1272 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:47:07.359595 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-e76a2afb-0061-4d20-8681-b31e1833f0f8 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:07.360945 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-e76a2afb-0061-4d20-8681-b31e1833f0f8 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 4fa1efb1-1488-48f4-a6ec-9b4787e01277] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:07.369689 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-e76a2afb-0061-4d20-8681-b31e1833f0f8 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:07.370134 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-e76a2afb-0061-4d20-8681-b31e1833f0f8 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:07.370936 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-e76a2afb-0061-4d20-8681-b31e1833f0f8 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:07.371372 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-e76a2afb-0061-4d20-8681-b31e1833f0f8 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:07.493664 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-c9f92bf3-cc76-41d3-a3f9-01eeb8bff6ad tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:07.494321 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-c9f92bf3-cc76-41d3-a3f9-01eeb8bff6ad tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 343ae383-5bfd-4c70-8926-a800fcee3519] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:07.517636 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-c9f92bf3-cc76-41d3-a3f9-01eeb8bff6ad tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:07.518787 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-c9f92bf3-cc76-41d3-a3f9-01eeb8bff6ad tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:07.521322 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-c9f92bf3-cc76-41d3-a3f9-01eeb8bff6ad tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:07.522101 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-c9f92bf3-cc76-41d3-a3f9-01eeb8bff6ad tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:07.703564 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-e76a2afb-0061-4d20-8681-b31e1833f0f8 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:07.711953 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-c9f92bf3-cc76-41d3-a3f9-01eeb8bff6ad tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c75043813844d79fd0764132dfe4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e234f713b40cd8772372c2316dd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:07.718830 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-e76a2afb-0061-4d20-8681-b31e1833f0f8 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277" status: 200 len: 1521 microversion: 2.1 time: 0.365626 Jul 19 15:47:07.719428 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 111/259] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:07 2022] GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277 => generated 1521 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:47:07.722095 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-c9f92bf3-cc76-41d3-a3f9-01eeb8bff6ad tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519" status: 200 len: 1363 microversion: 2.1 time: 0.232937 Jul 19 15:47:07.722706 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 149/260] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:07 2022] GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519 => generated 1363 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:47:07.871528 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-57dd37ee-9629-48c1-9aaa-052c3115dfa7 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:07.872229 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-57dd37ee-9629-48c1-9aaa-052c3115dfa7 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:07.885601 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-57dd37ee-9629-48c1-9aaa-052c3115dfa7 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:07.886050 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-57dd37ee-9629-48c1-9aaa-052c3115dfa7 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:07.889821 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-57dd37ee-9629-48c1-9aaa-052c3115dfa7 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:07.890425 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-57dd37ee-9629-48c1-9aaa-052c3115dfa7 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:07.985101 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-9277b380-34c2-490d-b015-91e30db56488 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:07.986288 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-9277b380-34c2-490d-b015-91e30db56488 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] [instance: 36b522b7-9f73-4cbf-b09d-57abc62dc90e] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:07.992921 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-9277b380-34c2-490d-b015-91e30db56488 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:07.993472 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-9277b380-34c2-490d-b015-91e30db56488 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:07.994212 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-9277b380-34c2-490d-b015-91e30db56488 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:07.994689 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-9277b380-34c2-490d-b015-91e30db56488 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:08.102746 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-57dd37ee-9629-48c1-9aaa-052c3115dfa7 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:08.112880 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-57dd37ee-9629-48c1-9aaa-052c3115dfa7 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:08.115164 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-57dd37ee-9629-48c1-9aaa-052c3115dfa7 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:08.116404 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-57dd37ee-9629-48c1-9aaa-052c3115dfa7 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 200 len: 1723 microversion: 2.20 time: 0.249796 Jul 19 15:47:08.117233 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 112/261] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:47:07 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 1723 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 15:47:08.134776 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-9277b380-34c2-490d-b015-91e30db56488 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc32c284f7e498e9d53402e73e76c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537dfdfbaae043f38cd4300e1b030682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:08.142745 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-9277b380-34c2-490d-b015-91e30db56488 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] 10.222.0.64 "GET /compute/v2.1/servers/36b522b7-9f73-4cbf-b09d-57abc62dc90e" status: 200 len: 1314 microversion: 2.1 time: 0.161314 Jul 19 15:47:08.143310 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 150/262] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:07 2022] GET /compute/v2.1/servers/36b522b7-9f73-4cbf-b09d-57abc62dc90e => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:47:08.396324 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [req-26c225bf-50fc-4e47-a2b1-a997c113c688 req-1f0a8ca0-a0b0-44df-a3b6-90b264ad2d6f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "343ae383-5bfd-4c70-8926-a800fcee3519", "name": "network-vif-plugged", "status": "completed", "tag": "a70da232-0d1f-4d96-ac45-c34ad79c41f8"}]} {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:47:08.412597 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [req-26c225bf-50fc-4e47-a2b1-a997c113c688 req-1f0a8ca0-a0b0-44df-a3b6-90b264ad2d6f service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:08.413293 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [req-26c225bf-50fc-4e47-a2b1-a997c113c688 req-1f0a8ca0-a0b0-44df-a3b6-90b264ad2d6f service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:08.444217 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.compute.server_external_events [req-26c225bf-50fc-4e47-a2b1-a997c113c688 req-1f0a8ca0-a0b0-44df-a3b6-90b264ad2d6f service nova] Creating event network-vif-plugged:a70da232-0d1f-4d96-ac45-c34ad79c41f8 for instance 343ae383-5bfd-4c70-8926-a800fcee3519 on hv-cinder-84902 Jul 19 15:47:08.455089 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [req-26c225bf-50fc-4e47-a2b1-a997c113c688 req-1f0a8ca0-a0b0-44df-a3b6-90b264ad2d6f service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064825 Jul 19 15:47:08.456292 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 113/263] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Jul 19 15:47:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:47:08.681462 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [req-1792c457-0241-4b79-873b-838866ed04c6 req-318e7848-451b-4c02-a7fa-f4dc9318f906 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "36b522b7-9f73-4cbf-b09d-57abc62dc90e", "tag": "4ed4f5bc-b69f-4ef0-8f66-4b15b16d0bd7"}]} {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:47:08.694067 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [req-1792c457-0241-4b79-873b-838866ed04c6 req-318e7848-451b-4c02-a7fa-f4dc9318f906 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:08.696610 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [req-1792c457-0241-4b79-873b-838866ed04c6 req-318e7848-451b-4c02-a7fa-f4dc9318f906 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:08.708454 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.compute.server_external_events [req-1792c457-0241-4b79-873b-838866ed04c6 req-318e7848-451b-4c02-a7fa-f4dc9318f906 service nova] Creating event network-changed:4ed4f5bc-b69f-4ef0-8f66-4b15b16d0bd7 for instance 36b522b7-9f73-4cbf-b09d-57abc62dc90e on hv-cinder-84902 Jul 19 15:47:08.713951 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [req-1792c457-0241-4b79-873b-838866ed04c6 req-318e7848-451b-4c02-a7fa-f4dc9318f906 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036233 Jul 19 15:47:08.714581 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 151/264] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Jul 19 15:47:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 15:47:08.740011 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-fdc2d7a9-2a13-45cf-878c-77588cffb56e tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:08.740752 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-fdc2d7a9-2a13-45cf-878c-77588cffb56e tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 4fa1efb1-1488-48f4-a6ec-9b4787e01277] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:08.740898 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-00357696-af00-4ccf-b4c7-64765cb1e5e4 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:08.741776 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-00357696-af00-4ccf-b4c7-64765cb1e5e4 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 343ae383-5bfd-4c70-8926-a800fcee3519] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:08.747688 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-fdc2d7a9-2a13-45cf-878c-77588cffb56e tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:08.748142 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-fdc2d7a9-2a13-45cf-878c-77588cffb56e tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:08.748751 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-00357696-af00-4ccf-b4c7-64765cb1e5e4 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:08.749165 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-fdc2d7a9-2a13-45cf-878c-77588cffb56e tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:08.749273 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-00357696-af00-4ccf-b4c7-64765cb1e5e4 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:08.749603 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-fdc2d7a9-2a13-45cf-878c-77588cffb56e tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:08.750248 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-00357696-af00-4ccf-b4c7-64765cb1e5e4 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:08.750738 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-00357696-af00-4ccf-b4c7-64765cb1e5e4 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:08.897117 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-00357696-af00-4ccf-b4c7-64765cb1e5e4 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c75043813844d79fd0764132dfe4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e234f713b40cd8772372c2316dd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:08.913295 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-00357696-af00-4ccf-b4c7-64765cb1e5e4 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519" status: 200 len: 1363 microversion: 2.1 time: 0.169333 Jul 19 15:47:08.913295 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 152/265] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:08 2022] GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519 => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:47:08.920487 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-fdc2d7a9-2a13-45cf-878c-77588cffb56e tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:08.928311 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-fdc2d7a9-2a13-45cf-878c-77588cffb56e tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277" status: 200 len: 1501 microversion: 2.1 time: 0.195031 Jul 19 15:47:08.928883 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 114/266] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:08 2022] GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277 => generated 1501 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:47:08.944430 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-923502ca-8564-4a98-b3d6-4be163732a36 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:08.945040 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-923502ca-8564-4a98-b3d6-4be163732a36 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 764ab5a7-4ebb-4d76-a34b-5f311883bcbe] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:08.951339 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-923502ca-8564-4a98-b3d6-4be163732a36 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:08.951791 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-923502ca-8564-4a98-b3d6-4be163732a36 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:08.952561 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-923502ca-8564-4a98-b3d6-4be163732a36 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:08.952997 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-923502ca-8564-4a98-b3d6-4be163732a36 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:09.091373 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-923502ca-8564-4a98-b3d6-4be163732a36 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:09.098926 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-923502ca-8564-4a98-b3d6-4be163732a36 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/764ab5a7-4ebb-4d76-a34b-5f311883bcbe" status: 200 len: 1515 microversion: 2.1 time: 0.158252 Jul 19 15:47:09.099497 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 153/267] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:08 2022] GET /compute/v2.1/servers/764ab5a7-4ebb-4d76-a34b-5f311883bcbe => generated 1515 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:47:09.136488 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-06d6dea9-fde4-42c1-8af6-8c98ade550b4 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:09.137119 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-06d6dea9-fde4-42c1-8af6-8c98ade550b4 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:09.144377 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-06d6dea9-fde4-42c1-8af6-8c98ade550b4 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:09.144824 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-06d6dea9-fde4-42c1-8af6-8c98ade550b4 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:09.145748 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-06d6dea9-fde4-42c1-8af6-8c98ade550b4 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:09.146344 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-06d6dea9-fde4-42c1-8af6-8c98ade550b4 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:09.164388 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-baf418d3-5e8b-4719-b2db-f96fbe541db1 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:09.165002 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-baf418d3-5e8b-4719-b2db-f96fbe541db1 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] [instance: 36b522b7-9f73-4cbf-b09d-57abc62dc90e] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:09.171212 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-baf418d3-5e8b-4719-b2db-f96fbe541db1 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:09.171663 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-baf418d3-5e8b-4719-b2db-f96fbe541db1 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:09.172434 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-baf418d3-5e8b-4719-b2db-f96fbe541db1 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:09.172961 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-baf418d3-5e8b-4719-b2db-f96fbe541db1 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:09.307322 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-06d6dea9-fde4-42c1-8af6-8c98ade550b4 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:09.316465 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-06d6dea9-fde4-42c1-8af6-8c98ade550b4 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:09.317462 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-baf418d3-5e8b-4719-b2db-f96fbe541db1 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc32c284f7e498e9d53402e73e76c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537dfdfbaae043f38cd4300e1b030682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:09.318809 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-06d6dea9-fde4-42c1-8af6-8c98ade550b4 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:09.320304 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-06d6dea9-fde4-42c1-8af6-8c98ade550b4 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 200 len: 1723 microversion: 2.20 time: 0.188559 Jul 19 15:47:09.321024 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 115/268] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:47:09 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 1723 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:47:09.322527 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG dbcounter [-] [129520] Writing DB stats nova_cell1:SELECT=100 {{(pid=129520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:09.328194 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-baf418d3-5e8b-4719-b2db-f96fbe541db1 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] 10.222.0.64 "GET /compute/v2.1/servers/36b522b7-9f73-4cbf-b09d-57abc62dc90e" status: 200 len: 1314 microversion: 2.1 time: 0.167859 Jul 19 15:47:09.329826 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 154/269] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:09 2022] GET /compute/v2.1/servers/36b522b7-9f73-4cbf-b09d-57abc62dc90e => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:47:09.922188 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-d2e15b02-41a3-4a08-ae08-8eda3a784380 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:09.922986 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-d2e15b02-41a3-4a08-ae08-8eda3a784380 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 343ae383-5bfd-4c70-8926-a800fcee3519] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:09.931791 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-d2e15b02-41a3-4a08-ae08-8eda3a784380 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:09.932501 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-d2e15b02-41a3-4a08-ae08-8eda3a784380 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:09.933724 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-d2e15b02-41a3-4a08-ae08-8eda3a784380 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:09.934442 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-d2e15b02-41a3-4a08-ae08-8eda3a784380 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:10.066943 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-d2e15b02-41a3-4a08-ae08-8eda3a784380 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c75043813844d79fd0764132dfe4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e234f713b40cd8772372c2316dd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:10.074221 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-d2e15b02-41a3-4a08-ae08-8eda3a784380 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519" status: 200 len: 1363 microversion: 2.1 time: 0.155823 Jul 19 15:47:10.074811 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 116/270] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:09 2022] GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:47:10.344142 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-1307bf27-6521-4218-a775-88865ff15cfe tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:10.344749 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-1307bf27-6521-4218-a775-88865ff15cfe tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:10.346023 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-14edf43b-e41c-4794-8b5a-ecc0e5a36fde tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:10.346733 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-14edf43b-e41c-4794-8b5a-ecc0e5a36fde tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] [instance: 36b522b7-9f73-4cbf-b09d-57abc62dc90e] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:10.351858 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-1307bf27-6521-4218-a775-88865ff15cfe tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:10.352355 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-1307bf27-6521-4218-a775-88865ff15cfe tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:10.352973 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-14edf43b-e41c-4794-8b5a-ecc0e5a36fde tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:10.353288 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-1307bf27-6521-4218-a775-88865ff15cfe tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:10.353432 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-14edf43b-e41c-4794-8b5a-ecc0e5a36fde tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:10.353796 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-1307bf27-6521-4218-a775-88865ff15cfe tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:10.354166 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-14edf43b-e41c-4794-8b5a-ecc0e5a36fde tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:10.354819 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-14edf43b-e41c-4794-8b5a-ecc0e5a36fde tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:10.372383 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG dbcounter [-] [129519] Writing DB stats nova_cell1:SELECT=100 {{(pid=129519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:10.497564 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-14edf43b-e41c-4794-8b5a-ecc0e5a36fde tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc32c284f7e498e9d53402e73e76c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537dfdfbaae043f38cd4300e1b030682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:10.505023 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-1307bf27-6521-4218-a775-88865ff15cfe tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:10.505170 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-14edf43b-e41c-4794-8b5a-ecc0e5a36fde tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] 10.222.0.64 "GET /compute/v2.1/servers/36b522b7-9f73-4cbf-b09d-57abc62dc90e" status: 200 len: 1314 microversion: 2.1 time: 0.163568 Jul 19 15:47:10.505702 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 117/271] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:10 2022] GET /compute/v2.1/servers/36b522b7-9f73-4cbf-b09d-57abc62dc90e => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:47:10.513254 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-1307bf27-6521-4218-a775-88865ff15cfe tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:10.514784 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-1307bf27-6521-4218-a775-88865ff15cfe tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:10.515972 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-1307bf27-6521-4218-a775-88865ff15cfe tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 200 len: 1723 microversion: 2.20 time: 0.175816 Jul 19 15:47:10.516508 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 155/272] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:47:10 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:47:11.091264 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-3ceecc84-b8e6-4869-be2a-a657b4a318cc tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:11.091860 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-3ceecc84-b8e6-4869-be2a-a657b4a318cc tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 343ae383-5bfd-4c70-8926-a800fcee3519] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:11.098635 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-3ceecc84-b8e6-4869-be2a-a657b4a318cc tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:11.099085 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-3ceecc84-b8e6-4869-be2a-a657b4a318cc tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:11.099845 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-3ceecc84-b8e6-4869-be2a-a657b4a318cc tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:11.100283 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-3ceecc84-b8e6-4869-be2a-a657b4a318cc tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:11.227758 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-3ceecc84-b8e6-4869-be2a-a657b4a318cc tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c75043813844d79fd0764132dfe4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e234f713b40cd8772372c2316dd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:11.235594 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-3ceecc84-b8e6-4869-be2a-a657b4a318cc tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519" status: 200 len: 1363 microversion: 2.1 time: 0.148009 Jul 19 15:47:11.237473 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 118/273] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:11 2022] GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:47:11.311011 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-a1bdcc66-0340-4f8c-ae06-f95aee0c8e6a tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:11.311637 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-a1bdcc66-0340-4f8c-ae06-f95aee0c8e6a tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: 5f1579c0-907a-490f-ad8e-0fe2db0baf97] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:11.321161 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-a1bdcc66-0340-4f8c-ae06-f95aee0c8e6a tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:11.321709 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-a1bdcc66-0340-4f8c-ae06-f95aee0c8e6a tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:11.322963 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-a1bdcc66-0340-4f8c-ae06-f95aee0c8e6a tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:11.323553 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-a1bdcc66-0340-4f8c-ae06-f95aee0c8e6a tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:11.350350 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-a1bdcc66-0340-4f8c-ae06-f95aee0c8e6a tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/5f1579c0-907a-490f-ad8e-0fe2db0baf97/ips" status: 200 len: 150 microversion: 2.1 time: 0.044137 Jul 19 15:47:11.351868 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 156/274] 10.222.0.64 () {58 vars in 1247 bytes} [Tue Jul 19 15:47:11 2022] GET /compute/v2.1/servers/5f1579c0-907a-490f-ad8e-0fe2db0baf97/ips => generated 150 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:47:11.525973 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-03982fa7-e740-4f72-93cf-9983299dc3d8 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:11.526750 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-03982fa7-e740-4f72-93cf-9983299dc3d8 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] [instance: 36b522b7-9f73-4cbf-b09d-57abc62dc90e] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:11.535456 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-607ef9d4-9acb-4626-a600-478fecf912cf tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:11.536543 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-607ef9d4-9acb-4626-a600-478fecf912cf tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:11.540060 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-03982fa7-e740-4f72-93cf-9983299dc3d8 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:11.540717 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-03982fa7-e740-4f72-93cf-9983299dc3d8 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:11.542023 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-03982fa7-e740-4f72-93cf-9983299dc3d8 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:11.542909 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-03982fa7-e740-4f72-93cf-9983299dc3d8 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:11.546495 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-607ef9d4-9acb-4626-a600-478fecf912cf tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:11.547353 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-607ef9d4-9acb-4626-a600-478fecf912cf tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:11.550101 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-607ef9d4-9acb-4626-a600-478fecf912cf tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:11.550805 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-607ef9d4-9acb-4626-a600-478fecf912cf tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:11.734434 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-607ef9d4-9acb-4626-a600-478fecf912cf tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:11.746288 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-607ef9d4-9acb-4626-a600-478fecf912cf tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:11.748095 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-607ef9d4-9acb-4626-a600-478fecf912cf tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:11.749317 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-607ef9d4-9acb-4626-a600-478fecf912cf tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 200 len: 1723 microversion: 2.20 time: 0.218965 Jul 19 15:47:11.750045 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 157/275] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:47:11 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 1723 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 15:47:12.056395 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-03982fa7-e740-4f72-93cf-9983299dc3d8 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc32c284f7e498e9d53402e73e76c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537dfdfbaae043f38cd4300e1b030682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:12.065351 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-03982fa7-e740-4f72-93cf-9983299dc3d8 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] 10.222.0.64 "GET /compute/v2.1/servers/36b522b7-9f73-4cbf-b09d-57abc62dc90e" status: 200 len: 1314 microversion: 2.1 time: 0.546464 Jul 19 15:47:12.065915 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 119/276] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:11 2022] GET /compute/v2.1/servers/36b522b7-9f73-4cbf-b09d-57abc62dc90e => generated 1314 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:47:12.254205 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-56ce6b07-2c63-4d72-80ef-5b76a2fe8837 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:12.254762 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-56ce6b07-2c63-4d72-80ef-5b76a2fe8837 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 343ae383-5bfd-4c70-8926-a800fcee3519] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:12.260756 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-56ce6b07-2c63-4d72-80ef-5b76a2fe8837 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:12.261204 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-56ce6b07-2c63-4d72-80ef-5b76a2fe8837 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:12.261964 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-56ce6b07-2c63-4d72-80ef-5b76a2fe8837 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:12.262421 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-56ce6b07-2c63-4d72-80ef-5b76a2fe8837 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:12.398985 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-56ce6b07-2c63-4d72-80ef-5b76a2fe8837 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c75043813844d79fd0764132dfe4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e234f713b40cd8772372c2316dd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:12.406433 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-56ce6b07-2c63-4d72-80ef-5b76a2fe8837 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519" status: 200 len: 1363 microversion: 2.1 time: 0.156927 Jul 19 15:47:12.407005 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 158/277] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:12 2022] GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:47:12.769533 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-c50e8722-15d8-49fa-897d-18dff84070d0 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:12.770145 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-c50e8722-15d8-49fa-897d-18dff84070d0 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:12.776810 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-c50e8722-15d8-49fa-897d-18dff84070d0 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:12.777259 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-c50e8722-15d8-49fa-897d-18dff84070d0 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:12.778020 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-c50e8722-15d8-49fa-897d-18dff84070d0 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:12.778483 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-c50e8722-15d8-49fa-897d-18dff84070d0 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:12.966082 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-c50e8722-15d8-49fa-897d-18dff84070d0 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:12.974272 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-c50e8722-15d8-49fa-897d-18dff84070d0 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:12.975785 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-c50e8722-15d8-49fa-897d-18dff84070d0 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:12.976929 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-c50e8722-15d8-49fa-897d-18dff84070d0 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 200 len: 1723 microversion: 2.20 time: 0.212015 Jul 19 15:47:12.977485 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 120/278] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:47:12 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 1723 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:47:13.082165 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-a8d423e7-6062-4ad9-8cbf-af9a2ee12300 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:13.082975 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-a8d423e7-6062-4ad9-8cbf-af9a2ee12300 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] [instance: 36b522b7-9f73-4cbf-b09d-57abc62dc90e] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:13.088985 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-a8d423e7-6062-4ad9-8cbf-af9a2ee12300 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:13.089436 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-a8d423e7-6062-4ad9-8cbf-af9a2ee12300 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:13.090198 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-a8d423e7-6062-4ad9-8cbf-af9a2ee12300 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:13.090667 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-a8d423e7-6062-4ad9-8cbf-af9a2ee12300 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:13.217572 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-a8d423e7-6062-4ad9-8cbf-af9a2ee12300 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc32c284f7e498e9d53402e73e76c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537dfdfbaae043f38cd4300e1b030682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:13.225640 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-a8d423e7-6062-4ad9-8cbf-af9a2ee12300 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] 10.222.0.64 "GET /compute/v2.1/servers/36b522b7-9f73-4cbf-b09d-57abc62dc90e" status: 200 len: 1314 microversion: 2.1 time: 0.147507 Jul 19 15:47:13.226198 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 159/279] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:13 2022] GET /compute/v2.1/servers/36b522b7-9f73-4cbf-b09d-57abc62dc90e => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:47:13.423211 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-da71c32f-9c8d-43f8-9b94-e69651c78adc tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:13.424396 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-da71c32f-9c8d-43f8-9b94-e69651c78adc tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 343ae383-5bfd-4c70-8926-a800fcee3519] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:13.430496 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-da71c32f-9c8d-43f8-9b94-e69651c78adc tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:13.430946 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-da71c32f-9c8d-43f8-9b94-e69651c78adc tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:13.431710 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-da71c32f-9c8d-43f8-9b94-e69651c78adc tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:13.432145 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-da71c32f-9c8d-43f8-9b94-e69651c78adc tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:13.629309 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-da71c32f-9c8d-43f8-9b94-e69651c78adc tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c75043813844d79fd0764132dfe4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e234f713b40cd8772372c2316dd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:13.637066 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-da71c32f-9c8d-43f8-9b94-e69651c78adc tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519" status: 200 len: 1549 microversion: 2.1 time: 0.217684 Jul 19 15:47:13.637632 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 121/280] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:13 2022] GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519 => generated 1549 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:47:13.653157 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-a4388df0-f13a-4371-ade6-40c8320d87ba tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:13.653658 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-a4388df0-f13a-4371-ade6-40c8320d87ba tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 343ae383-5bfd-4c70-8926-a800fcee3519] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:13.660232 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-a4388df0-f13a-4371-ade6-40c8320d87ba tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:13.660679 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-a4388df0-f13a-4371-ade6-40c8320d87ba tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:13.661697 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-a4388df0-f13a-4371-ade6-40c8320d87ba tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:13.662130 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-a4388df0-f13a-4371-ade6-40c8320d87ba tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:13.742848 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-a4388df0-f13a-4371-ade6-40c8320d87ba tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093536 Jul 19 15:47:13.743470 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 160/281] 10.222.0.64 () {58 vars in 1274 bytes} [Tue Jul 19 15:47:13 2022] GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:47:13.995392 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-abafed1d-35ea-43ce-bd84-8bf4fffd4164 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:13.996030 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-abafed1d-35ea-43ce-bd84-8bf4fffd4164 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:14.003744 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-abafed1d-35ea-43ce-bd84-8bf4fffd4164 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:14.004186 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-abafed1d-35ea-43ce-bd84-8bf4fffd4164 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:14.005032 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-abafed1d-35ea-43ce-bd84-8bf4fffd4164 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:14.005531 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-abafed1d-35ea-43ce-bd84-8bf4fffd4164 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:14.153917 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-abafed1d-35ea-43ce-bd84-8bf4fffd4164 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:14.164482 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-abafed1d-35ea-43ce-bd84-8bf4fffd4164 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:14.166134 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-abafed1d-35ea-43ce-bd84-8bf4fffd4164 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:14.176828 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-abafed1d-35ea-43ce-bd84-8bf4fffd4164 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 200 len: 1723 microversion: 2.20 time: 0.176342 Jul 19 15:47:14.176828 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 122/282] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:47:13 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 1723 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:47:14.243355 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-e0716be6-c007-4a79-9d1f-a4065d4b2b00 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:14.244002 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-e0716be6-c007-4a79-9d1f-a4065d4b2b00 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] [instance: 36b522b7-9f73-4cbf-b09d-57abc62dc90e] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:14.250010 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-e0716be6-c007-4a79-9d1f-a4065d4b2b00 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:14.250428 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-e0716be6-c007-4a79-9d1f-a4065d4b2b00 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:14.251192 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-e0716be6-c007-4a79-9d1f-a4065d4b2b00 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:14.251696 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-e0716be6-c007-4a79-9d1f-a4065d4b2b00 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:14.481743 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-e0716be6-c007-4a79-9d1f-a4065d4b2b00 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc32c284f7e498e9d53402e73e76c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537dfdfbaae043f38cd4300e1b030682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:14.489782 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-e0716be6-c007-4a79-9d1f-a4065d4b2b00 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] 10.222.0.64 "GET /compute/v2.1/servers/36b522b7-9f73-4cbf-b09d-57abc62dc90e" status: 200 len: 1314 microversion: 2.1 time: 0.250333 Jul 19 15:47:14.490370 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 161/283] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:14 2022] GET /compute/v2.1/servers/36b522b7-9f73-4cbf-b09d-57abc62dc90e => generated 1314 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:47:14.703012 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-ce995d68-f39f-4bcd-aacb-f8660a111763 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:47:14.704028 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-ce995d68-f39f-4bcd-aacb-f8660a111763 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 764ab5a7-4ebb-4d76-a34b-5f311883bcbe] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:14.710468 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-ce995d68-f39f-4bcd-aacb-f8660a111763 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:14.710957 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-ce995d68-f39f-4bcd-aacb-f8660a111763 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:14.711689 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-ce995d68-f39f-4bcd-aacb-f8660a111763 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:14.712119 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-ce995d68-f39f-4bcd-aacb-f8660a111763 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:14.741205 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.objects.instance [None req-ce995d68-f39f-4bcd-aacb-f8660a111763 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lazy-loading 'flavor' on Instance uuid 764ab5a7-4ebb-4d76-a34b-5f311883bcbe {{(pid=129519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 15:47:14.965560 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-8a118240-fd6d-4557-b149-64a85f7c521e tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "83467c1e-b417-4388-8ef3-ba7c30379327"}} {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:47:14.966912 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-8a118240-fd6d-4557-b149-64a85f7c521e tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: 5f1579c0-907a-490f-ad8e-0fe2db0baf97] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:14.974405 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-8a118240-fd6d-4557-b149-64a85f7c521e tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:14.975754 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-8a118240-fd6d-4557-b149-64a85f7c521e tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:14.976711 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-8a118240-fd6d-4557-b149-64a85f7c521e tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:14.977444 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-8a118240-fd6d-4557-b149-64a85f7c521e tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:15.118789 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-ce995d68-f39f-4bcd-aacb-f8660a111763 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "POST /compute/v2.1/servers/764ab5a7-4ebb-4d76-a34b-5f311883bcbe/action" status: 200 len: 32 microversion: 2.1 time: 0.418993 Jul 19 15:47:15.119826 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 123/284] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Jul 19 15:47:14 2022] POST /compute/v2.1/servers/764ab5a7-4ebb-4d76-a34b-5f311883bcbe/action => generated 32 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 15:47:15.125839 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [req-e0c155dc-2bb1-4b5a-987f-d7b9f2277977 req-7b3409a4-473b-4e10-b743-2f25fe8738a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "343ae383-5bfd-4c70-8926-a800fcee3519", "tag": "a70da232-0d1f-4d96-ac45-c34ad79c41f8"}]} {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:47:15.136593 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [req-e0c155dc-2bb1-4b5a-987f-d7b9f2277977 req-7b3409a4-473b-4e10-b743-2f25fe8738a3 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:15.137594 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [req-e0c155dc-2bb1-4b5a-987f-d7b9f2277977 req-7b3409a4-473b-4e10-b743-2f25fe8738a3 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:15.176947 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.compute.server_external_events [req-e0c155dc-2bb1-4b5a-987f-d7b9f2277977 req-7b3409a4-473b-4e10-b743-2f25fe8738a3 service nova] Creating event network-changed:a70da232-0d1f-4d96-ac45-c34ad79c41f8 for instance 343ae383-5bfd-4c70-8926-a800fcee3519 on hv-cinder-84902 Jul 19 15:47:15.188059 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [req-e0c155dc-2bb1-4b5a-987f-d7b9f2277977 req-7b3409a4-473b-4e10-b743-2f25fe8738a3 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065216 Jul 19 15:47:15.189181 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 124/285] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Jul 19 15:47:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:47:15.199768 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-217c6ae4-5900-4a85-b19c-e5c44852b360 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:15.200813 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-217c6ae4-5900-4a85-b19c-e5c44852b360 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 764ab5a7-4ebb-4d76-a34b-5f311883bcbe] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:15.208676 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-217c6ae4-5900-4a85-b19c-e5c44852b360 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:15.209443 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-217c6ae4-5900-4a85-b19c-e5c44852b360 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:15.210421 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-217c6ae4-5900-4a85-b19c-e5c44852b360 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:15.211014 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-217c6ae4-5900-4a85-b19c-e5c44852b360 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:15.437388 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-217c6ae4-5900-4a85-b19c-e5c44852b360 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:15.445125 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-217c6ae4-5900-4a85-b19c-e5c44852b360 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/764ab5a7-4ebb-4d76-a34b-5f311883bcbe" status: 200 len: 1521 microversion: 2.1 time: 0.250287 Jul 19 15:47:15.446190 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 125/286] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:15 2022] GET /compute/v2.1/servers/764ab5a7-4ebb-4d76-a34b-5f311883bcbe => generated 1521 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:47:15.464377 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-afffee9f-86cf-41b9-8e90-218a857bfdda tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:15.465217 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-afffee9f-86cf-41b9-8e90-218a857bfdda tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:15.473318 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-afffee9f-86cf-41b9-8e90-218a857bfdda tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:15.473764 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-afffee9f-86cf-41b9-8e90-218a857bfdda tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:15.474845 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-afffee9f-86cf-41b9-8e90-218a857bfdda tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:15.476078 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-afffee9f-86cf-41b9-8e90-218a857bfdda tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:15.486849 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-8a118240-fd6d-4557-b149-64a85f7c521e tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "POST /compute/v2.1/servers/5f1579c0-907a-490f-ad8e-0fe2db0baf97/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.522531 Jul 19 15:47:15.492651 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 162/287] 10.222.0.64 () {60 vars in 1322 bytes} [Tue Jul 19 15:47:14 2022] POST /compute/v2.1/servers/5f1579c0-907a-490f-ad8e-0fe2db0baf97/os-volume_attachments => generated 194 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 15:47:15.509878 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-312a9348-7f29-4e4a-a187-c9dc402f9a1a tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:15.510833 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-312a9348-7f29-4e4a-a187-c9dc402f9a1a tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] [instance: 36b522b7-9f73-4cbf-b09d-57abc62dc90e] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:15.525541 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-312a9348-7f29-4e4a-a187-c9dc402f9a1a tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:15.526110 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-312a9348-7f29-4e4a-a187-c9dc402f9a1a tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:15.526789 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-312a9348-7f29-4e4a-a187-c9dc402f9a1a tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:15.527230 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-312a9348-7f29-4e4a-a187-c9dc402f9a1a tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:15.727807 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-afffee9f-86cf-41b9-8e90-218a857bfdda tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:15.737460 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-afffee9f-86cf-41b9-8e90-218a857bfdda tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:15.739018 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-afffee9f-86cf-41b9-8e90-218a857bfdda tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:15.740202 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-afffee9f-86cf-41b9-8e90-218a857bfdda tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 200 len: 1723 microversion: 2.20 time: 0.292722 Jul 19 15:47:15.741457 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 126/288] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:47:15 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 1723 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:47:15.758547 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-312a9348-7f29-4e4a-a187-c9dc402f9a1a tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc32c284f7e498e9d53402e73e76c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537dfdfbaae043f38cd4300e1b030682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:15.767089 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-312a9348-7f29-4e4a-a187-c9dc402f9a1a tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] 10.222.0.64 "GET /compute/v2.1/servers/36b522b7-9f73-4cbf-b09d-57abc62dc90e" status: 200 len: 1314 microversion: 2.1 time: 0.262641 Jul 19 15:47:15.767767 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 163/289] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:15 2022] GET /compute/v2.1/servers/36b522b7-9f73-4cbf-b09d-57abc62dc90e => generated 1314 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:47:16.463724 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-82b4f71c-3e6f-4ada-8cdb-29fe4e51e468 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:16.464333 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-82b4f71c-3e6f-4ada-8cdb-29fe4e51e468 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 764ab5a7-4ebb-4d76-a34b-5f311883bcbe] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:16.473195 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-82b4f71c-3e6f-4ada-8cdb-29fe4e51e468 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:16.473867 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-82b4f71c-3e6f-4ada-8cdb-29fe4e51e468 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:16.474830 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-82b4f71c-3e6f-4ada-8cdb-29fe4e51e468 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:16.475467 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-82b4f71c-3e6f-4ada-8cdb-29fe4e51e468 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:16.665268 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-82b4f71c-3e6f-4ada-8cdb-29fe4e51e468 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:16.675319 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-82b4f71c-3e6f-4ada-8cdb-29fe4e51e468 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/764ab5a7-4ebb-4d76-a34b-5f311883bcbe" status: 200 len: 1521 microversion: 2.1 time: 0.215449 Jul 19 15:47:16.676203 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 127/290] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:16 2022] GET /compute/v2.1/servers/764ab5a7-4ebb-4d76-a34b-5f311883bcbe => generated 1521 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:47:16.758899 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-650fa977-cd77-4a2b-92ea-f875675bf089 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:16.759630 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-650fa977-cd77-4a2b-92ea-f875675bf089 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:16.770857 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-650fa977-cd77-4a2b-92ea-f875675bf089 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:16.771387 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-650fa977-cd77-4a2b-92ea-f875675bf089 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:16.772261 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-650fa977-cd77-4a2b-92ea-f875675bf089 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:16.772786 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-650fa977-cd77-4a2b-92ea-f875675bf089 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:16.785036 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-405378df-d2d6-4cb1-b63c-b6df46ede4a9 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:16.785638 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-405378df-d2d6-4cb1-b63c-b6df46ede4a9 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] [instance: 36b522b7-9f73-4cbf-b09d-57abc62dc90e] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:16.792355 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-405378df-d2d6-4cb1-b63c-b6df46ede4a9 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:16.793013 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-405378df-d2d6-4cb1-b63c-b6df46ede4a9 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:16.793772 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-405378df-d2d6-4cb1-b63c-b6df46ede4a9 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:16.794196 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-405378df-d2d6-4cb1-b63c-b6df46ede4a9 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:16.942144 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-650fa977-cd77-4a2b-92ea-f875675bf089 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:16.945282 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-405378df-d2d6-4cb1-b63c-b6df46ede4a9 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc32c284f7e498e9d53402e73e76c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537dfdfbaae043f38cd4300e1b030682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:16.953649 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-405378df-d2d6-4cb1-b63c-b6df46ede4a9 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] 10.222.0.64 "GET /compute/v2.1/servers/36b522b7-9f73-4cbf-b09d-57abc62dc90e" status: 200 len: 1314 microversion: 2.1 time: 0.173263 Jul 19 15:47:16.954315 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-650fa977-cd77-4a2b-92ea-f875675bf089 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:16.955976 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-650fa977-cd77-4a2b-92ea-f875675bf089 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:16.957428 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-650fa977-cd77-4a2b-92ea-f875675bf089 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 200 len: 1723 microversion: 2.20 time: 0.202763 Jul 19 15:47:16.966781 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 164/291] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:47:16 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 1723 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:47:16.967050 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 128/292] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:16 2022] GET /compute/v2.1/servers/36b522b7-9f73-4cbf-b09d-57abc62dc90e => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:47:17.695516 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-05211048-4005-4309-adc3-c1613a1d0318 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:17.696146 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-05211048-4005-4309-adc3-c1613a1d0318 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 764ab5a7-4ebb-4d76-a34b-5f311883bcbe] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:17.711294 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-05211048-4005-4309-adc3-c1613a1d0318 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:17.711738 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-05211048-4005-4309-adc3-c1613a1d0318 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:17.712505 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-05211048-4005-4309-adc3-c1613a1d0318 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:17.712935 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-05211048-4005-4309-adc3-c1613a1d0318 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:17.937265 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-05211048-4005-4309-adc3-c1613a1d0318 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:17.949281 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-05211048-4005-4309-adc3-c1613a1d0318 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/764ab5a7-4ebb-4d76-a34b-5f311883bcbe" status: 200 len: 1521 microversion: 2.1 time: 0.260083 Jul 19 15:47:17.950134 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 165/293] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:17 2022] GET /compute/v2.1/servers/764ab5a7-4ebb-4d76-a34b-5f311883bcbe => generated 1521 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:47:17.973304 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-8f503ef3-543f-449a-a895-7301ae8ae4e7 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:17.975154 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-8f503ef3-543f-449a-a895-7301ae8ae4e7 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] [instance: 36b522b7-9f73-4cbf-b09d-57abc62dc90e] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:17.976314 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-18e1d4de-0af5-4e0f-81f6-f107c62ca5ea tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:17.977145 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-18e1d4de-0af5-4e0f-81f6-f107c62ca5ea tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:17.983896 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-18e1d4de-0af5-4e0f-81f6-f107c62ca5ea tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:17.984393 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-18e1d4de-0af5-4e0f-81f6-f107c62ca5ea tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:17.985263 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-8f503ef3-543f-449a-a895-7301ae8ae4e7 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:17.985616 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-18e1d4de-0af5-4e0f-81f6-f107c62ca5ea tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:17.986467 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-8f503ef3-543f-449a-a895-7301ae8ae4e7 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:17.987509 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-8f503ef3-543f-449a-a895-7301ae8ae4e7 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:17.987706 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-18e1d4de-0af5-4e0f-81f6-f107c62ca5ea tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:17.988861 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-8f503ef3-543f-449a-a895-7301ae8ae4e7 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:18.257046 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-18e1d4de-0af5-4e0f-81f6-f107c62ca5ea tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:18.265910 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-18e1d4de-0af5-4e0f-81f6-f107c62ca5ea tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:18.268426 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-18e1d4de-0af5-4e0f-81f6-f107c62ca5ea tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:18.270386 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-18e1d4de-0af5-4e0f-81f6-f107c62ca5ea tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 200 len: 1723 microversion: 2.20 time: 0.298690 Jul 19 15:47:18.271249 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 166/294] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:47:17 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 1723 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:47:18.333929 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-8f503ef3-543f-449a-a895-7301ae8ae4e7 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc32c284f7e498e9d53402e73e76c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537dfdfbaae043f38cd4300e1b030682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:18.343521 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-8f503ef3-543f-449a-a895-7301ae8ae4e7 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] 10.222.0.64 "GET /compute/v2.1/servers/36b522b7-9f73-4cbf-b09d-57abc62dc90e" status: 200 len: 1314 microversion: 2.1 time: 0.376660 Jul 19 15:47:18.345161 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 129/295] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:17 2022] GET /compute/v2.1/servers/36b522b7-9f73-4cbf-b09d-57abc62dc90e => generated 1314 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:47:18.968355 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-b2593bb7-ed7f-4e75-82e5-7ec71e6c1b2a tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:18.968964 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-b2593bb7-ed7f-4e75-82e5-7ec71e6c1b2a tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 764ab5a7-4ebb-4d76-a34b-5f311883bcbe] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:18.976702 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b2593bb7-ed7f-4e75-82e5-7ec71e6c1b2a tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:18.977395 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b2593bb7-ed7f-4e75-82e5-7ec71e6c1b2a tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:18.978530 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b2593bb7-ed7f-4e75-82e5-7ec71e6c1b2a tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:18.979108 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b2593bb7-ed7f-4e75-82e5-7ec71e6c1b2a tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:19.198447 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-b2593bb7-ed7f-4e75-82e5-7ec71e6c1b2a tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:19.208941 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-b2593bb7-ed7f-4e75-82e5-7ec71e6c1b2a tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/764ab5a7-4ebb-4d76-a34b-5f311883bcbe" status: 200 len: 1521 microversion: 2.1 time: 0.245981 Jul 19 15:47:19.210410 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 167/296] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:18 2022] GET /compute/v2.1/servers/764ab5a7-4ebb-4d76-a34b-5f311883bcbe => generated 1521 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:47:19.290054 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-695fce01-68f2-49fe-9fab-061ebad92ad7 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:19.290923 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-695fce01-68f2-49fe-9fab-061ebad92ad7 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:19.308736 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-695fce01-68f2-49fe-9fab-061ebad92ad7 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:19.309207 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-695fce01-68f2-49fe-9fab-061ebad92ad7 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:19.309986 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-695fce01-68f2-49fe-9fab-061ebad92ad7 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:19.314521 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-695fce01-68f2-49fe-9fab-061ebad92ad7 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:19.367968 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-54792244-1db1-474c-afa0-921a9c713d00 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:19.368753 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-54792244-1db1-474c-afa0-921a9c713d00 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] [instance: 36b522b7-9f73-4cbf-b09d-57abc62dc90e] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:19.378751 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-54792244-1db1-474c-afa0-921a9c713d00 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:19.379345 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-54792244-1db1-474c-afa0-921a9c713d00 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:19.380428 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-54792244-1db1-474c-afa0-921a9c713d00 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:19.381076 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-54792244-1db1-474c-afa0-921a9c713d00 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:19.565681 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-695fce01-68f2-49fe-9fab-061ebad92ad7 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:19.576821 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-695fce01-68f2-49fe-9fab-061ebad92ad7 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:19.578042 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-695fce01-68f2-49fe-9fab-061ebad92ad7 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:19.581676 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-695fce01-68f2-49fe-9fab-061ebad92ad7 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 200 len: 1723 microversion: 2.20 time: 0.295920 Jul 19 15:47:19.582849 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 130/297] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:47:19 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 1723 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:47:19.891847 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-54792244-1db1-474c-afa0-921a9c713d00 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc32c284f7e498e9d53402e73e76c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537dfdfbaae043f38cd4300e1b030682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:19.901967 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-54792244-1db1-474c-afa0-921a9c713d00 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] 10.222.0.64 "GET /compute/v2.1/servers/36b522b7-9f73-4cbf-b09d-57abc62dc90e" status: 200 len: 1314 microversion: 2.1 time: 0.544240 Jul 19 15:47:19.903246 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 168/298] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:19 2022] GET /compute/v2.1/servers/36b522b7-9f73-4cbf-b09d-57abc62dc90e => generated 1314 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:47:20.227358 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-ec527090-37f5-4622-863a-8e7a7afb4dae tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:20.228188 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-ec527090-37f5-4622-863a-8e7a7afb4dae tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 764ab5a7-4ebb-4d76-a34b-5f311883bcbe] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:20.235065 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-ec527090-37f5-4622-863a-8e7a7afb4dae tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:20.236393 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-ec527090-37f5-4622-863a-8e7a7afb4dae tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:20.237234 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-ec527090-37f5-4622-863a-8e7a7afb4dae tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:20.237814 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-ec527090-37f5-4622-863a-8e7a7afb4dae tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:20.390127 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-ec527090-37f5-4622-863a-8e7a7afb4dae tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:20.398034 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-ec527090-37f5-4622-863a-8e7a7afb4dae tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/764ab5a7-4ebb-4d76-a34b-5f311883bcbe" status: 200 len: 1521 microversion: 2.1 time: 0.174765 Jul 19 15:47:20.398630 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 131/299] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:20 2022] GET /compute/v2.1/servers/764ab5a7-4ebb-4d76-a34b-5f311883bcbe => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:47:20.600315 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-751cff63-1b8a-4f95-b131-5a420ab03b95 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:20.601502 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-751cff63-1b8a-4f95-b131-5a420ab03b95 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:20.607856 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-751cff63-1b8a-4f95-b131-5a420ab03b95 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:20.608511 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-751cff63-1b8a-4f95-b131-5a420ab03b95 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:20.609424 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-751cff63-1b8a-4f95-b131-5a420ab03b95 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:20.610001 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-751cff63-1b8a-4f95-b131-5a420ab03b95 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:20.901149 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-751cff63-1b8a-4f95-b131-5a420ab03b95 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:20.919667 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-7fdb586a-9916-4bb3-97c8-bc86f6a7127f tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:20.920363 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-7fdb586a-9916-4bb3-97c8-bc86f6a7127f tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] [instance: 36b522b7-9f73-4cbf-b09d-57abc62dc90e] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:20.927310 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-7fdb586a-9916-4bb3-97c8-bc86f6a7127f tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:20.927857 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-7fdb586a-9916-4bb3-97c8-bc86f6a7127f tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:20.928285 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-751cff63-1b8a-4f95-b131-5a420ab03b95 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:20.929493 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-7fdb586a-9916-4bb3-97c8-bc86f6a7127f tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:20.930200 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-7fdb586a-9916-4bb3-97c8-bc86f6a7127f tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:20.930385 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-751cff63-1b8a-4f95-b131-5a420ab03b95 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:20.932293 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-751cff63-1b8a-4f95-b131-5a420ab03b95 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 200 len: 1723 microversion: 2.20 time: 0.335767 Jul 19 15:47:20.933003 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 169/300] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:47:20 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 1723 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:47:21.104996 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-7fdb586a-9916-4bb3-97c8-bc86f6a7127f tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc32c284f7e498e9d53402e73e76c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537dfdfbaae043f38cd4300e1b030682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:21.108557 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG dbcounter [-] [129519] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:21.114280 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-7fdb586a-9916-4bb3-97c8-bc86f6a7127f tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] 10.222.0.64 "GET /compute/v2.1/servers/36b522b7-9f73-4cbf-b09d-57abc62dc90e" status: 200 len: 1314 microversion: 2.1 time: 0.198913 Jul 19 15:47:21.115135 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 132/301] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:20 2022] GET /compute/v2.1/servers/36b522b7-9f73-4cbf-b09d-57abc62dc90e => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:47:21.370676 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [req-15635fa7-da69-40e4-b3e5-7c20ef0f139c req-8d7d871a-ab65-4a96-ab39-fb0400adba5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36b522b7-9f73-4cbf-b09d-57abc62dc90e", "name": "network-vif-plugged", "status": "completed", "tag": "4ed4f5bc-b69f-4ef0-8f66-4b15b16d0bd7"}]} {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:47:21.380707 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [req-15635fa7-da69-40e4-b3e5-7c20ef0f139c req-8d7d871a-ab65-4a96-ab39-fb0400adba5c service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:21.381408 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [req-15635fa7-da69-40e4-b3e5-7c20ef0f139c req-8d7d871a-ab65-4a96-ab39-fb0400adba5c service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:21.415281 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-d3bb7b5b-f6ad-4185-a8ed-50aa904feab2 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:21.415892 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-d3bb7b5b-f6ad-4185-a8ed-50aa904feab2 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 764ab5a7-4ebb-4d76-a34b-5f311883bcbe] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:21.431507 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-d3bb7b5b-f6ad-4185-a8ed-50aa904feab2 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:21.431962 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-d3bb7b5b-f6ad-4185-a8ed-50aa904feab2 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:21.432729 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-d3bb7b5b-f6ad-4185-a8ed-50aa904feab2 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:21.437727 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-d3bb7b5b-f6ad-4185-a8ed-50aa904feab2 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:21.443097 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.compute.server_external_events [req-15635fa7-da69-40e4-b3e5-7c20ef0f139c req-8d7d871a-ab65-4a96-ab39-fb0400adba5c service nova] Creating event network-vif-plugged:4ed4f5bc-b69f-4ef0-8f66-4b15b16d0bd7 for instance 36b522b7-9f73-4cbf-b09d-57abc62dc90e on hv-cinder-84902 Jul 19 15:47:21.456515 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [req-15635fa7-da69-40e4-b3e5-7c20ef0f139c req-8d7d871a-ab65-4a96-ab39-fb0400adba5c service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088610 Jul 19 15:47:21.459613 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 170/302] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Jul 19 15:47:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:47:21.676918 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-d3bb7b5b-f6ad-4185-a8ed-50aa904feab2 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:21.695543 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-d3bb7b5b-f6ad-4185-a8ed-50aa904feab2 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/764ab5a7-4ebb-4d76-a34b-5f311883bcbe" status: 200 len: 1521 microversion: 2.1 time: 0.284570 Jul 19 15:47:21.696126 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 133/303] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:21 2022] GET /compute/v2.1/servers/764ab5a7-4ebb-4d76-a34b-5f311883bcbe => generated 1521 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:47:21.952621 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-519ca6e5-3a3d-4561-bf66-0c60350e2f41 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:21.953401 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-519ca6e5-3a3d-4561-bf66-0c60350e2f41 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:21.961714 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-519ca6e5-3a3d-4561-bf66-0c60350e2f41 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:21.966947 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-519ca6e5-3a3d-4561-bf66-0c60350e2f41 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:21.970199 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-519ca6e5-3a3d-4561-bf66-0c60350e2f41 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:21.971009 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-519ca6e5-3a3d-4561-bf66-0c60350e2f41 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:21.998491 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG dbcounter [-] [129520] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:22.132173 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-25a71f8a-f8c1-4181-9d32-e2ddb1e03e01 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:22.133001 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-25a71f8a-f8c1-4181-9d32-e2ddb1e03e01 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] [instance: 36b522b7-9f73-4cbf-b09d-57abc62dc90e] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:22.141080 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-25a71f8a-f8c1-4181-9d32-e2ddb1e03e01 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:22.142391 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-25a71f8a-f8c1-4181-9d32-e2ddb1e03e01 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:22.144116 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-25a71f8a-f8c1-4181-9d32-e2ddb1e03e01 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:22.144704 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-25a71f8a-f8c1-4181-9d32-e2ddb1e03e01 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:22.213162 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-519ca6e5-3a3d-4561-bf66-0c60350e2f41 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:22.224561 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-519ca6e5-3a3d-4561-bf66-0c60350e2f41 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:22.226080 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-519ca6e5-3a3d-4561-bf66-0c60350e2f41 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:22.227283 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-519ca6e5-3a3d-4561-bf66-0c60350e2f41 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 200 len: 1723 microversion: 2.20 time: 0.279090 Jul 19 15:47:22.227840 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 171/304] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:47:21 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 1723 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 15:47:22.321056 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-25a71f8a-f8c1-4181-9d32-e2ddb1e03e01 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc32c284f7e498e9d53402e73e76c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537dfdfbaae043f38cd4300e1b030682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:22.330186 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-25a71f8a-f8c1-4181-9d32-e2ddb1e03e01 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] 10.222.0.64 "GET /compute/v2.1/servers/36b522b7-9f73-4cbf-b09d-57abc62dc90e" status: 200 len: 1314 microversion: 2.1 time: 0.201283 Jul 19 15:47:22.339739 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 134/305] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:22 2022] GET /compute/v2.1/servers/36b522b7-9f73-4cbf-b09d-57abc62dc90e => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:47:22.713009 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-e454fb97-4834-4eba-8c91-9b0a468f06f9 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:22.713701 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-e454fb97-4834-4eba-8c91-9b0a468f06f9 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 764ab5a7-4ebb-4d76-a34b-5f311883bcbe] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:22.719833 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-e454fb97-4834-4eba-8c91-9b0a468f06f9 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:22.720962 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-e454fb97-4834-4eba-8c91-9b0a468f06f9 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:22.721716 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-e454fb97-4834-4eba-8c91-9b0a468f06f9 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:22.722473 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-e454fb97-4834-4eba-8c91-9b0a468f06f9 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:22.926083 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-e454fb97-4834-4eba-8c91-9b0a468f06f9 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:22.936088 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-e454fb97-4834-4eba-8c91-9b0a468f06f9 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/764ab5a7-4ebb-4d76-a34b-5f311883bcbe" status: 200 len: 1521 microversion: 2.1 time: 0.227074 Jul 19 15:47:22.936990 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 172/306] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:22 2022] GET /compute/v2.1/servers/764ab5a7-4ebb-4d76-a34b-5f311883bcbe => generated 1521 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:47:23.246751 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-0806018d-2816-4624-89d6-5ca100dd913f tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:23.247360 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-0806018d-2816-4624-89d6-5ca100dd913f tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:23.254931 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-0806018d-2816-4624-89d6-5ca100dd913f tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:23.255409 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-0806018d-2816-4624-89d6-5ca100dd913f tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:23.256266 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-0806018d-2816-4624-89d6-5ca100dd913f tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:23.256732 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-0806018d-2816-4624-89d6-5ca100dd913f tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:23.360262 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-216e696f-66b9-4c4a-b845-8411de23ebf0 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:23.361909 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-216e696f-66b9-4c4a-b845-8411de23ebf0 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] [instance: 36b522b7-9f73-4cbf-b09d-57abc62dc90e] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:23.389007 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-216e696f-66b9-4c4a-b845-8411de23ebf0 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:23.389655 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-216e696f-66b9-4c4a-b845-8411de23ebf0 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:23.390631 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-216e696f-66b9-4c4a-b845-8411de23ebf0 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:23.391219 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-216e696f-66b9-4c4a-b845-8411de23ebf0 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:23.582289 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-0806018d-2816-4624-89d6-5ca100dd913f tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:23.590985 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-0806018d-2816-4624-89d6-5ca100dd913f tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:23.614755 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-0806018d-2816-4624-89d6-5ca100dd913f tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:23.617176 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-0806018d-2816-4624-89d6-5ca100dd913f tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 200 len: 1723 microversion: 2.20 time: 0.374622 Jul 19 15:47:23.619988 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 135/307] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:47:23 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 1723 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:47:23.780250 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-216e696f-66b9-4c4a-b845-8411de23ebf0 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc32c284f7e498e9d53402e73e76c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537dfdfbaae043f38cd4300e1b030682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:23.803909 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-216e696f-66b9-4c4a-b845-8411de23ebf0 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] 10.222.0.64 "GET /compute/v2.1/servers/36b522b7-9f73-4cbf-b09d-57abc62dc90e" status: 200 len: 1314 microversion: 2.1 time: 0.460398 Jul 19 15:47:23.814280 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 173/308] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:23 2022] GET /compute/v2.1/servers/36b522b7-9f73-4cbf-b09d-57abc62dc90e => generated 1314 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:47:23.955103 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-93f3a227-60b9-4891-96fc-e6e491d20a0b tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:23.956015 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-93f3a227-60b9-4891-96fc-e6e491d20a0b tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 764ab5a7-4ebb-4d76-a34b-5f311883bcbe] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:23.982488 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-93f3a227-60b9-4891-96fc-e6e491d20a0b tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:23.983300 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-93f3a227-60b9-4891-96fc-e6e491d20a0b tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:23.984363 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-93f3a227-60b9-4891-96fc-e6e491d20a0b tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:23.985255 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-93f3a227-60b9-4891-96fc-e6e491d20a0b tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:24.219616 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-93f3a227-60b9-4891-96fc-e6e491d20a0b tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:24.234578 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-93f3a227-60b9-4891-96fc-e6e491d20a0b tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/764ab5a7-4ebb-4d76-a34b-5f311883bcbe" status: 200 len: 1521 microversion: 2.1 time: 0.284925 Jul 19 15:47:24.236601 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 136/309] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:23 2022] GET /compute/v2.1/servers/764ab5a7-4ebb-4d76-a34b-5f311883bcbe => generated 1521 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:47:24.638649 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-c533e8c9-1ac4-4afb-a590-34f8523e487e tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:24.639849 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-c533e8c9-1ac4-4afb-a590-34f8523e487e tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:24.648131 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-c533e8c9-1ac4-4afb-a590-34f8523e487e tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:24.648724 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-c533e8c9-1ac4-4afb-a590-34f8523e487e tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:24.649937 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-c533e8c9-1ac4-4afb-a590-34f8523e487e tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:24.650538 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-c533e8c9-1ac4-4afb-a590-34f8523e487e tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:24.821695 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-92c2108a-6fe6-459c-bf0c-69e7a4513d29 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:24.822938 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-92c2108a-6fe6-459c-bf0c-69e7a4513d29 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] [instance: 36b522b7-9f73-4cbf-b09d-57abc62dc90e] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:24.830115 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-92c2108a-6fe6-459c-bf0c-69e7a4513d29 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:24.830824 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-92c2108a-6fe6-459c-bf0c-69e7a4513d29 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:24.831598 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-92c2108a-6fe6-459c-bf0c-69e7a4513d29 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:24.832188 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-92c2108a-6fe6-459c-bf0c-69e7a4513d29 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:25.016591 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-c533e8c9-1ac4-4afb-a590-34f8523e487e tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:25.030271 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-c533e8c9-1ac4-4afb-a590-34f8523e487e tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:25.031723 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-c533e8c9-1ac4-4afb-a590-34f8523e487e tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:25.033029 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-c533e8c9-1ac4-4afb-a590-34f8523e487e tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 200 len: 1744 microversion: 2.20 time: 0.399376 Jul 19 15:47:25.033642 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 174/310] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:47:24 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 1744 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:47:25.049867 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-92c2108a-6fe6-459c-bf0c-69e7a4513d29 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc32c284f7e498e9d53402e73e76c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537dfdfbaae043f38cd4300e1b030682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:25.057953 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-92c2108a-6fe6-459c-bf0c-69e7a4513d29 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] 10.222.0.64 "GET /compute/v2.1/servers/36b522b7-9f73-4cbf-b09d-57abc62dc90e" status: 200 len: 1314 microversion: 2.1 time: 0.240439 Jul 19 15:47:25.059176 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 137/311] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:24 2022] GET /compute/v2.1/servers/36b522b7-9f73-4cbf-b09d-57abc62dc90e => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:47:25.254602 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-9aba7dea-851a-4f29-bf69-3359786ebd7b tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:25.255314 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-9aba7dea-851a-4f29-bf69-3359786ebd7b tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 764ab5a7-4ebb-4d76-a34b-5f311883bcbe] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:25.275431 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-9aba7dea-851a-4f29-bf69-3359786ebd7b tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:25.276520 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-9aba7dea-851a-4f29-bf69-3359786ebd7b tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:25.279499 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-9aba7dea-851a-4f29-bf69-3359786ebd7b tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:25.279954 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-9aba7dea-851a-4f29-bf69-3359786ebd7b tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:25.601027 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-9aba7dea-851a-4f29-bf69-3359786ebd7b tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:25.609803 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-9aba7dea-851a-4f29-bf69-3359786ebd7b tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/764ab5a7-4ebb-4d76-a34b-5f311883bcbe" status: 200 len: 1521 microversion: 2.1 time: 0.360778 Jul 19 15:47:25.612057 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 175/312] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:25 2022] GET /compute/v2.1/servers/764ab5a7-4ebb-4d76-a34b-5f311883bcbe => generated 1521 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:47:26.054224 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-62f88530-9ee0-4b71-9a80-7800684f214b tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:26.054936 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-62f88530-9ee0-4b71-9a80-7800684f214b tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:26.068795 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-62f88530-9ee0-4b71-9a80-7800684f214b tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:26.075216 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-62f88530-9ee0-4b71-9a80-7800684f214b tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:26.076578 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-62f88530-9ee0-4b71-9a80-7800684f214b tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:26.077425 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-62f88530-9ee0-4b71-9a80-7800684f214b tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:26.081471 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-7216ec5d-0d55-4ba1-b181-71f429890450 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:26.083640 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-7216ec5d-0d55-4ba1-b181-71f429890450 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] [instance: 36b522b7-9f73-4cbf-b09d-57abc62dc90e] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:26.101069 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-7216ec5d-0d55-4ba1-b181-71f429890450 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:26.101832 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-7216ec5d-0d55-4ba1-b181-71f429890450 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:26.103527 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-7216ec5d-0d55-4ba1-b181-71f429890450 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:26.104739 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-7216ec5d-0d55-4ba1-b181-71f429890450 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:26.349320 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-62f88530-9ee0-4b71-9a80-7800684f214b tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:26.378594 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-62f88530-9ee0-4b71-9a80-7800684f214b tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:26.386435 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-62f88530-9ee0-4b71-9a80-7800684f214b tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:26.394286 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-62f88530-9ee0-4b71-9a80-7800684f214b tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 200 len: 1744 microversion: 2.20 time: 0.338040 Jul 19 15:47:26.408766 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 138/313] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:47:26 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 1744 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 15:47:26.482932 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-7216ec5d-0d55-4ba1-b181-71f429890450 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc32c284f7e498e9d53402e73e76c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537dfdfbaae043f38cd4300e1b030682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:26.494954 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-7216ec5d-0d55-4ba1-b181-71f429890450 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] 10.222.0.64 "GET /compute/v2.1/servers/36b522b7-9f73-4cbf-b09d-57abc62dc90e" status: 200 len: 1314 microversion: 2.1 time: 0.422120 Jul 19 15:47:26.497690 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 176/314] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:26 2022] GET /compute/v2.1/servers/36b522b7-9f73-4cbf-b09d-57abc62dc90e => generated 1314 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:47:26.627027 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-45543077-84bf-4b02-aaa3-53b890a0799e tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:26.627913 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-45543077-84bf-4b02-aaa3-53b890a0799e tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 764ab5a7-4ebb-4d76-a34b-5f311883bcbe] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:26.639567 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-45543077-84bf-4b02-aaa3-53b890a0799e tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:26.640666 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-45543077-84bf-4b02-aaa3-53b890a0799e tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:26.641601 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-45543077-84bf-4b02-aaa3-53b890a0799e tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:26.646772 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-45543077-84bf-4b02-aaa3-53b890a0799e tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:27.417270 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-841b3715-b9bb-4aa8-af82-2c304aeebd76 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:27.418574 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-841b3715-b9bb-4aa8-af82-2c304aeebd76 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:27.427365 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-45543077-84bf-4b02-aaa3-53b890a0799e tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:27.434723 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-841b3715-b9bb-4aa8-af82-2c304aeebd76 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:27.435439 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-841b3715-b9bb-4aa8-af82-2c304aeebd76 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:27.438475 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-841b3715-b9bb-4aa8-af82-2c304aeebd76 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:27.440383 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-841b3715-b9bb-4aa8-af82-2c304aeebd76 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:27.441742 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-45543077-84bf-4b02-aaa3-53b890a0799e tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/764ab5a7-4ebb-4d76-a34b-5f311883bcbe" status: 200 len: 1521 microversion: 2.1 time: 0.818991 Jul 19 15:47:27.446729 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 139/315] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:26 2022] GET /compute/v2.1/servers/764ab5a7-4ebb-4d76-a34b-5f311883bcbe => generated 1521 bytes in 825 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:47:27.512930 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-87a1a408-cf26-478b-b8cb-1e4fe5c1de99 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:27.513531 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-87a1a408-cf26-478b-b8cb-1e4fe5c1de99 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] [instance: 36b522b7-9f73-4cbf-b09d-57abc62dc90e] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:27.529190 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-87a1a408-cf26-478b-b8cb-1e4fe5c1de99 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:27.530161 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-87a1a408-cf26-478b-b8cb-1e4fe5c1de99 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:27.531975 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-87a1a408-cf26-478b-b8cb-1e4fe5c1de99 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:27.533065 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-87a1a408-cf26-478b-b8cb-1e4fe5c1de99 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:27.855666 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-87a1a408-cf26-478b-b8cb-1e4fe5c1de99 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc32c284f7e498e9d53402e73e76c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537dfdfbaae043f38cd4300e1b030682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:27.873323 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-87a1a408-cf26-478b-b8cb-1e4fe5c1de99 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] 10.222.0.64 "GET /compute/v2.1/servers/36b522b7-9f73-4cbf-b09d-57abc62dc90e" status: 200 len: 1314 microversion: 2.1 time: 0.364268 Jul 19 15:47:27.873909 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 140/316] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:27 2022] GET /compute/v2.1/servers/36b522b7-9f73-4cbf-b09d-57abc62dc90e => generated 1314 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:47:27.897342 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-841b3715-b9bb-4aa8-af82-2c304aeebd76 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:27.909444 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-841b3715-b9bb-4aa8-af82-2c304aeebd76 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:27.912573 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-841b3715-b9bb-4aa8-af82-2c304aeebd76 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:27.913792 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-841b3715-b9bb-4aa8-af82-2c304aeebd76 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 200 len: 1744 microversion: 2.20 time: 0.502300 Jul 19 15:47:27.928253 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 177/317] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:47:27 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 1744 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:47:28.464970 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-b9aef175-714e-44be-a4a9-e4101757f0cc tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:28.466198 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-b9aef175-714e-44be-a4a9-e4101757f0cc tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 764ab5a7-4ebb-4d76-a34b-5f311883bcbe] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:28.487561 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-b9aef175-714e-44be-a4a9-e4101757f0cc tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:28.488609 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-b9aef175-714e-44be-a4a9-e4101757f0cc tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:28.490297 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-b9aef175-714e-44be-a4a9-e4101757f0cc tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:28.495465 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-b9aef175-714e-44be-a4a9-e4101757f0cc tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:28.894752 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-c0a83415-6afc-4478-9548-ecc8a46fd237 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:28.896323 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-c0a83415-6afc-4478-9548-ecc8a46fd237 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] [instance: 36b522b7-9f73-4cbf-b09d-57abc62dc90e] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:28.900720 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-b9aef175-714e-44be-a4a9-e4101757f0cc tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:28.911807 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-c0a83415-6afc-4478-9548-ecc8a46fd237 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:28.912263 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-c0a83415-6afc-4478-9548-ecc8a46fd237 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:28.915186 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-c0a83415-6afc-4478-9548-ecc8a46fd237 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:28.915819 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-c0a83415-6afc-4478-9548-ecc8a46fd237 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:28.929416 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-b9aef175-714e-44be-a4a9-e4101757f0cc tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/764ab5a7-4ebb-4d76-a34b-5f311883bcbe" status: 200 len: 1521 microversion: 2.1 time: 0.469072 Jul 19 15:47:28.934908 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 141/318] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:28 2022] GET /compute/v2.1/servers/764ab5a7-4ebb-4d76-a34b-5f311883bcbe => generated 1521 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:47:28.948039 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-5c4ef798-383e-4fcc-83ca-883672bd54be tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:28.953099 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-5c4ef798-383e-4fcc-83ca-883672bd54be tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:28.973128 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-5c4ef798-383e-4fcc-83ca-883672bd54be tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:28.975131 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-5c4ef798-383e-4fcc-83ca-883672bd54be tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:28.976287 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-5c4ef798-383e-4fcc-83ca-883672bd54be tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:28.978293 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-5c4ef798-383e-4fcc-83ca-883672bd54be tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:29.161612 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-c0a83415-6afc-4478-9548-ecc8a46fd237 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc32c284f7e498e9d53402e73e76c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537dfdfbaae043f38cd4300e1b030682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:29.171796 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-c0a83415-6afc-4478-9548-ecc8a46fd237 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] 10.222.0.64 "GET /compute/v2.1/servers/36b522b7-9f73-4cbf-b09d-57abc62dc90e" status: 200 len: 1314 microversion: 2.1 time: 0.283615 Jul 19 15:47:29.172392 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 178/319] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:28 2022] GET /compute/v2.1/servers/36b522b7-9f73-4cbf-b09d-57abc62dc90e => generated 1314 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:47:29.382791 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-5c4ef798-383e-4fcc-83ca-883672bd54be tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:29.394871 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-5c4ef798-383e-4fcc-83ca-883672bd54be tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:29.398738 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-5c4ef798-383e-4fcc-83ca-883672bd54be tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:29.402018 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-5c4ef798-383e-4fcc-83ca-883672bd54be tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 200 len: 1744 microversion: 2.20 time: 0.464009 Jul 19 15:47:29.402744 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 142/320] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:47:28 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 1744 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:47:29.954505 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-4524abc4-7589-41fa-86e1-45db90670b96 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:29.956803 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-4524abc4-7589-41fa-86e1-45db90670b96 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 764ab5a7-4ebb-4d76-a34b-5f311883bcbe] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:29.973570 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-4524abc4-7589-41fa-86e1-45db90670b96 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:29.974030 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-4524abc4-7589-41fa-86e1-45db90670b96 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:29.977434 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-4524abc4-7589-41fa-86e1-45db90670b96 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:29.977909 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-4524abc4-7589-41fa-86e1-45db90670b96 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:30.190209 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-89178017-d2a6-4a5d-aadf-7298a39fa8b0 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:30.195095 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-89178017-d2a6-4a5d-aadf-7298a39fa8b0 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] [instance: 36b522b7-9f73-4cbf-b09d-57abc62dc90e] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:30.217441 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-89178017-d2a6-4a5d-aadf-7298a39fa8b0 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:30.231348 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-89178017-d2a6-4a5d-aadf-7298a39fa8b0 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:30.234023 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-89178017-d2a6-4a5d-aadf-7298a39fa8b0 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:30.235105 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-89178017-d2a6-4a5d-aadf-7298a39fa8b0 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:30.385669 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-4524abc4-7589-41fa-86e1-45db90670b96 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:30.399575 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-4524abc4-7589-41fa-86e1-45db90670b96 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/764ab5a7-4ebb-4d76-a34b-5f311883bcbe" status: 200 len: 1521 microversion: 2.1 time: 0.452252 Jul 19 15:47:30.400172 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 179/321] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:29 2022] GET /compute/v2.1/servers/764ab5a7-4ebb-4d76-a34b-5f311883bcbe => generated 1521 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:47:30.529997 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-89178017-d2a6-4a5d-aadf-7298a39fa8b0 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc32c284f7e498e9d53402e73e76c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537dfdfbaae043f38cd4300e1b030682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:30.538346 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-89178017-d2a6-4a5d-aadf-7298a39fa8b0 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] 10.222.0.64 "GET /compute/v2.1/servers/36b522b7-9f73-4cbf-b09d-57abc62dc90e" status: 200 len: 1464 microversion: 2.1 time: 0.352597 Jul 19 15:47:30.542029 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 143/322] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:30 2022] GET /compute/v2.1/servers/36b522b7-9f73-4cbf-b09d-57abc62dc90e => generated 1464 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:47:30.558855 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-e88a78ed-5431-4d1c-8eaf-93933d1e2c5c tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:30.559585 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-e88a78ed-5431-4d1c-8eaf-93933d1e2c5c tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:30.573648 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-e88a78ed-5431-4d1c-8eaf-93933d1e2c5c tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:30.573865 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-e88a78ed-5431-4d1c-8eaf-93933d1e2c5c tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:30.576918 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-e88a78ed-5431-4d1c-8eaf-93933d1e2c5c tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:30.578293 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-e88a78ed-5431-4d1c-8eaf-93933d1e2c5c tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:30.725724 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-e0dd5522-59dc-4b70-afb9-06a874d60334 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Action: 'create', calling method: .version_select at 0x7fb8a67014c0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-701832674", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLvtibBgOxBE44rDvBsou3qyWmfIsLyk5f/mVEOEV9x5ciIYeMpPoJlBS1pc8vBLFmZkApkfK1c64UVDvyCjsZspPhXzI8goUb4WHijEc9GI3sfleXXVOE/rHdyJMMUI6A=="}} {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:47:30.757412 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.quota [None req-e0dd5522-59dc-4b70-afb9-06a874d60334 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Getting quotas for project 6827afcdf1f3481882f808dc01908a4d. Resources: {'key_pairs'} {{(pid=129520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 15:47:30.762648 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.quota [None req-e0dd5522-59dc-4b70-afb9-06a874d60334 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Getting quotas for user ae334c4d93cd4d3e94789a5985fcfa77 and project 6827afcdf1f3481882f808dc01908a4d. Resources: {'key_pairs'} {{(pid=129520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 15:47:30.797247 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-e88a78ed-5431-4d1c-8eaf-93933d1e2c5c tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:30.809367 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-e0dd5522-59dc-4b70-afb9-06a874d60334 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.407529 Jul 19 15:47:30.810229 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 180/323] 10.222.0.64 () {60 vars in 1158 bytes} [Tue Jul 19 15:47:30 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:47:30.815575 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-e88a78ed-5431-4d1c-8eaf-93933d1e2c5c tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:30.824778 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-b769e3bc-ccac-4112-b550-09f4e93f5db3 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:30.825633 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-b769e3bc-ccac-4112-b550-09f4e93f5db3 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] [instance: 36b522b7-9f73-4cbf-b09d-57abc62dc90e] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:30.826651 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-e88a78ed-5431-4d1c-8eaf-93933d1e2c5c tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:30.833578 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-e88a78ed-5431-4d1c-8eaf-93933d1e2c5c tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 200 len: 1744 microversion: 2.20 time: 0.289766 Jul 19 15:47:30.835814 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b769e3bc-ccac-4112-b550-09f4e93f5db3 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:30.836584 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b769e3bc-ccac-4112-b550-09f4e93f5db3 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:30.837624 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b769e3bc-ccac-4112-b550-09f4e93f5db3 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:30.838414 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b769e3bc-ccac-4112-b550-09f4e93f5db3 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:30.840449 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 144/324] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:47:30 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 1744 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:47:30.889458 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-b769e3bc-ccac-4112-b550-09f4e93f5db3 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] [instance: 36b522b7-9f73-4cbf-b09d-57abc62dc90e] Going to try to terminate instance {{(pid=129520) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 15:47:31.072656 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-b769e3bc-ccac-4112-b550-09f4e93f5db3 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] 10.222.0.64 "DELETE /compute/v2.1/servers/36b522b7-9f73-4cbf-b09d-57abc62dc90e" status: 204 len: 0 microversion: 2.1 time: 0.254212 Jul 19 15:47:31.075530 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 181/325] 10.222.0.64 () {58 vars in 1238 bytes} [Tue Jul 19 15:47:30 2022] DELETE /compute/v2.1/servers/36b522b7-9f73-4cbf-b09d-57abc62dc90e => generated 0 bytes in 264 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 15:47:31.086852 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-d6fd32f2-8183-42ac-9ff2-6961dbd6c592 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:31.088348 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-d6fd32f2-8183-42ac-9ff2-6961dbd6c592 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] [instance: 36b522b7-9f73-4cbf-b09d-57abc62dc90e] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:31.097498 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-d6fd32f2-8183-42ac-9ff2-6961dbd6c592 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:31.098045 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-d6fd32f2-8183-42ac-9ff2-6961dbd6c592 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:31.129246 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-d6fd32f2-8183-42ac-9ff2-6961dbd6c592 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:31.129906 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-d6fd32f2-8183-42ac-9ff2-6961dbd6c592 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:31.232933 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [req-b273891d-6557-46a4-88b1-1335782c7919 req-0ef93e12-32a7-4d15-b736-173d96e60d83 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3eeb4a51-a06c-4faf-9a63-bf3658ca773b", "name": "network-vif-plugged", "status": "completed", "tag": "61483d93-6fa5-46d1-b820-a274f98ffcbb"}]} {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:47:31.255658 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [req-b273891d-6557-46a4-88b1-1335782c7919 req-0ef93e12-32a7-4d15-b736-173d96e60d83 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:31.256576 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [req-b273891d-6557-46a4-88b1-1335782c7919 req-0ef93e12-32a7-4d15-b736-173d96e60d83 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:31.274238 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.compute.server_external_events [req-b273891d-6557-46a4-88b1-1335782c7919 req-0ef93e12-32a7-4d15-b736-173d96e60d83 service nova] Creating event network-vif-plugged:61483d93-6fa5-46d1-b820-a274f98ffcbb for instance 3eeb4a51-a06c-4faf-9a63-bf3658ca773b on hv-cinder-84902 Jul 19 15:47:31.281677 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [req-b273891d-6557-46a4-88b1-1335782c7919 req-0ef93e12-32a7-4d15-b736-173d96e60d83 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054051 Jul 19 15:47:31.282620 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 182/326] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Jul 19 15:47:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 15:47:31.369596 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-d6fd32f2-8183-42ac-9ff2-6961dbd6c592 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc32c284f7e498e9d53402e73e76c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537dfdfbaae043f38cd4300e1b030682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:31.380322 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-d6fd32f2-8183-42ac-9ff2-6961dbd6c592 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] 10.222.0.64 "GET /compute/v2.1/servers/36b522b7-9f73-4cbf-b09d-57abc62dc90e" status: 200 len: 1470 microversion: 2.1 time: 0.299714 Jul 19 15:47:31.392629 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 145/327] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:31 2022] GET /compute/v2.1/servers/36b522b7-9f73-4cbf-b09d-57abc62dc90e => generated 1470 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:47:31.418259 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-c36d3b9a-8235-4224-b450-e05d13b2c6cc tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:31.419237 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-c36d3b9a-8235-4224-b450-e05d13b2c6cc tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 764ab5a7-4ebb-4d76-a34b-5f311883bcbe] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:31.432290 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-c36d3b9a-8235-4224-b450-e05d13b2c6cc tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:31.433120 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-c36d3b9a-8235-4224-b450-e05d13b2c6cc tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:31.434338 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-c36d3b9a-8235-4224-b450-e05d13b2c6cc tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:31.435091 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-c36d3b9a-8235-4224-b450-e05d13b2c6cc tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:31.696937 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-c36d3b9a-8235-4224-b450-e05d13b2c6cc tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:31.706316 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-c36d3b9a-8235-4224-b450-e05d13b2c6cc tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/764ab5a7-4ebb-4d76-a34b-5f311883bcbe" status: 200 len: 1521 microversion: 2.1 time: 0.292930 Jul 19 15:47:31.706930 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 183/328] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:31 2022] GET /compute/v2.1/servers/764ab5a7-4ebb-4d76-a34b-5f311883bcbe => generated 1521 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:47:31.862215 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-cf23da32-6ea3-4186-9da1-65be5eb1d3b0 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:31.862901 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-cf23da32-6ea3-4186-9da1-65be5eb1d3b0 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:31.870222 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-cf23da32-6ea3-4186-9da1-65be5eb1d3b0 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:31.870759 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-cf23da32-6ea3-4186-9da1-65be5eb1d3b0 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:31.871640 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-cf23da32-6ea3-4186-9da1-65be5eb1d3b0 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:31.872391 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-cf23da32-6ea3-4186-9da1-65be5eb1d3b0 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:32.147084 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-cf23da32-6ea3-4186-9da1-65be5eb1d3b0 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:32.159061 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-cf23da32-6ea3-4186-9da1-65be5eb1d3b0 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:32.159851 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-cf23da32-6ea3-4186-9da1-65be5eb1d3b0 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:32.161165 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-cf23da32-6ea3-4186-9da1-65be5eb1d3b0 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 200 len: 1739 microversion: 2.20 time: 0.303926 Jul 19 15:47:32.162273 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 146/329] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:47:31 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 1739 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:47:32.177097 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-f6bd923a-1819-4baf-98cc-654be8ddd438 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Action: 'create', calling method: .version_select at 0x7fb8a5c96a60>, body: {"keypair": {"name": "tempest-keypair-101818663", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJAlkSa+H96m0b5925/1UseQEM4Nlivo00mgpTOkSEvztutMqlP4LysO+Z3FaZYjw4PW8rf5rvGDKtUK1ahEp6Pa0WCSSA7YdYFuN+CHrEgWn8mkYtnHVd1oWub0HNIXng=="}} {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:47:32.195440 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.quota [None req-f6bd923a-1819-4baf-98cc-654be8ddd438 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Getting quotas for project 45a72d232f314a78b0e1c3f04b0ed682. Resources: {'key_pairs'} {{(pid=129520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 15:47:32.200921 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.quota [None req-f6bd923a-1819-4baf-98cc-654be8ddd438 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Getting quotas for user 2d7c42cf0bc84292bb0b7edb9f2e7fc3 and project 45a72d232f314a78b0e1c3f04b0ed682. Resources: {'key_pairs'} {{(pid=129520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 15:47:32.211781 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG dbcounter [-] [129520] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=129520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:32.232883 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-f6bd923a-1819-4baf-98cc-654be8ddd438 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.060859 Jul 19 15:47:32.233823 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 184/330] 10.222.0.64 () {60 vars in 1158 bytes} [Tue Jul 19 15:47:32 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:47:32.401088 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-bedfa137-e9fd-48c0-bff5-6a900f1b96f3 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:32.401709 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-bedfa137-e9fd-48c0-bff5-6a900f1b96f3 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] [instance: 36b522b7-9f73-4cbf-b09d-57abc62dc90e] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:32.409598 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-bedfa137-e9fd-48c0-bff5-6a900f1b96f3 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:32.410052 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-bedfa137-e9fd-48c0-bff5-6a900f1b96f3 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:32.410859 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-bedfa137-e9fd-48c0-bff5-6a900f1b96f3 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:32.411550 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-bedfa137-e9fd-48c0-bff5-6a900f1b96f3 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:32.629334 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-bedfa137-e9fd-48c0-bff5-6a900f1b96f3 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc32c284f7e498e9d53402e73e76c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537dfdfbaae043f38cd4300e1b030682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:32.650513 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-bedfa137-e9fd-48c0-bff5-6a900f1b96f3 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] 10.222.0.64 "GET /compute/v2.1/servers/36b522b7-9f73-4cbf-b09d-57abc62dc90e" status: 200 len: 1470 microversion: 2.1 time: 0.250755 Jul 19 15:47:32.652888 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 147/331] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:32 2022] GET /compute/v2.1/servers/36b522b7-9f73-4cbf-b09d-57abc62dc90e => generated 1470 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:47:32.726788 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-91034737-248e-4420-b18d-058bf0a529c9 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:32.727648 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-91034737-248e-4420-b18d-058bf0a529c9 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 764ab5a7-4ebb-4d76-a34b-5f311883bcbe] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:32.734683 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-91034737-248e-4420-b18d-058bf0a529c9 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:32.735075 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-d41f9bbe-4a02-4fa3-b356-b78daf3e0fd9 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-791327716", "imageRef": "15012099-fe38-45ac-bd33-d884a5ba65f2", "flavorRef": "452", "networks": [{"uuid": "ff064e7f-b96b-4a93-a399-a8dfccadf354"}]}} {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:47:32.737013 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-91034737-248e-4420-b18d-058bf0a529c9 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:32.738217 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-91034737-248e-4420-b18d-058bf0a529c9 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:32.738688 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-91034737-248e-4420-b18d-058bf0a529c9 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:32.800831 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.network.neutron [None req-d41f9bbe-4a02-4fa3-b356-b78daf3e0fd9 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] validate_networks() for [('ff064e7f-b96b-4a93-a399-a8dfccadf354', None, None, None, None, None)] {{(pid=129519) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 15:47:32.891500 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-91034737-248e-4420-b18d-058bf0a529c9 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:32.902298 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-91034737-248e-4420-b18d-058bf0a529c9 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/764ab5a7-4ebb-4d76-a34b-5f311883bcbe" status: 200 len: 1521 microversion: 2.1 time: 0.182719 Jul 19 15:47:32.903029 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 185/332] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:32 2022] GET /compute/v2.1/servers/764ab5a7-4ebb-4d76-a34b-5f311883bcbe => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:47:33.181083 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-36c6959e-1556-4f14-95a1-8eb23cecca21 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:33.181797 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-36c6959e-1556-4f14-95a1-8eb23cecca21 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:33.188309 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-36c6959e-1556-4f14-95a1-8eb23cecca21 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:33.189508 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-36c6959e-1556-4f14-95a1-8eb23cecca21 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:33.190482 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-36c6959e-1556-4f14-95a1-8eb23cecca21 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:33.190933 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-36c6959e-1556-4f14-95a1-8eb23cecca21 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:33.242013 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.virt.hardware [None req-d41f9bbe-4a02-4fa3-b356-b78daf3e0fd9 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Flavor limits 0:0:0 {{(pid=129519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 15:47:33.242474 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.virt.hardware [None req-d41f9bbe-4a02-4fa3-b356-b78daf3e0fd9 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Image limits 0:0:0 {{(pid=129519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 15:47:33.242952 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.virt.hardware [None req-d41f9bbe-4a02-4fa3-b356-b78daf3e0fd9 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Flavor pref 0:0:0 {{(pid=129519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 15:47:33.243360 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.virt.hardware [None req-d41f9bbe-4a02-4fa3-b356-b78daf3e0fd9 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Image pref 0:0:0 {{(pid=129519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 15:47:33.243771 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.virt.hardware [None req-d41f9bbe-4a02-4fa3-b356-b78daf3e0fd9 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 15:47:33.253197 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-d41f9bbe-4a02-4fa3-b356-b78daf3e0fd9 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:33.253639 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-d41f9bbe-4a02-4fa3-b356-b78daf3e0fd9 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:33.254458 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-d41f9bbe-4a02-4fa3-b356-b78daf3e0fd9 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:33.254899 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-d41f9bbe-4a02-4fa3-b356-b78daf3e0fd9 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:33.279073 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.quota [None req-d41f9bbe-4a02-4fa3-b356-b78daf3e0fd9 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Getting quotas for project 41bf5203b925421b9dd2ccc5b7d40ad8. Resources: {'ram', 'instances', 'cores'} {{(pid=129519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 15:47:33.287325 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.quota [None req-d41f9bbe-4a02-4fa3-b356-b78daf3e0fd9 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Getting quotas for user 86bf2b338eac47f6bcf20a48770b2e01 and project 41bf5203b925421b9dd2ccc5b7d40ad8. Resources: {'ram', 'instances', 'cores'} {{(pid=129519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 15:47:33.300260 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-d41f9bbe-4a02-4fa3-b356-b78daf3e0fd9 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Going to run 1 instances... {{(pid=129519) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 15:47:33.302749 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-d41f9bbe-4a02-4fa3-b356-b78daf3e0fd9 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] [instance: 4157bc30-5973-4e95-a9de-fa467709484e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='15012099-fe38-45ac-bd33-d884a5ba65f2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 15:47:33.324145 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG dbcounter [-] [129519] Writing DB stats nova_api:SELECT=98,nova_api:INSERT=2 {{(pid=129519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:33.358589 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-d41f9bbe-4a02-4fa3-b356-b78daf3e0fd9 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.627351 Jul 19 15:47:33.365988 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 148/333] 10.222.0.64 () {60 vars in 1146 bytes} [Tue Jul 19 15:47:32 2022] POST /compute/v2.1/servers => generated 380 bytes in 635 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 15:47:33.373620 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-884ea9e4-2abb-4e1c-bfa9-475ecb97020d tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:33.374504 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-884ea9e4-2abb-4e1c-bfa9-475ecb97020d tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] [instance: 4157bc30-5973-4e95-a9de-fa467709484e] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:33.423696 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-36c6959e-1556-4f14-95a1-8eb23cecca21 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:33.436447 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-36c6959e-1556-4f14-95a1-8eb23cecca21 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:33.438037 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-36c6959e-1556-4f14-95a1-8eb23cecca21 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:33.439229 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-36c6959e-1556-4f14-95a1-8eb23cecca21 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 200 len: 1739 microversion: 2.20 time: 0.262281 Jul 19 15:47:33.439803 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 186/334] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:47:33 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 1739 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 15:47:33.483729 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-884ea9e4-2abb-4e1c-bfa9-475ecb97020d tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf2b338eac47f6bcf20a48770b2e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41bf5203b925421b9dd2ccc5b7d40ad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:33.497583 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-884ea9e4-2abb-4e1c-bfa9-475ecb97020d tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] 10.222.0.64 "GET /compute/v2.1/servers/4157bc30-5973-4e95-a9de-fa467709484e" status: 200 len: 1218 microversion: 2.1 time: 0.129750 Jul 19 15:47:33.498936 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 149/335] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:33 2022] GET /compute/v2.1/servers/4157bc30-5973-4e95-a9de-fa467709484e => generated 1218 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:47:33.672860 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-f9560806-6513-4bba-8fa1-ae38bc7069e6 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:33.674244 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-f9560806-6513-4bba-8fa1-ae38bc7069e6 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] [instance: 36b522b7-9f73-4cbf-b09d-57abc62dc90e] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:33.686256 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-f9560806-6513-4bba-8fa1-ae38bc7069e6 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:33.690930 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-f9560806-6513-4bba-8fa1-ae38bc7069e6 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:33.692051 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-f9560806-6513-4bba-8fa1-ae38bc7069e6 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:33.692764 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-f9560806-6513-4bba-8fa1-ae38bc7069e6 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:33.928130 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-9cdf9c90-5719-4450-a777-e402505bf938 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:33.931330 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-9cdf9c90-5719-4450-a777-e402505bf938 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 764ab5a7-4ebb-4d76-a34b-5f311883bcbe] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:33.945207 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-9cdf9c90-5719-4450-a777-e402505bf938 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:33.945570 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-9cdf9c90-5719-4450-a777-e402505bf938 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:33.946386 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-9cdf9c90-5719-4450-a777-e402505bf938 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:33.947658 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-9cdf9c90-5719-4450-a777-e402505bf938 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:34.018893 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-f9560806-6513-4bba-8fa1-ae38bc7069e6 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc32c284f7e498e9d53402e73e76c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537dfdfbaae043f38cd4300e1b030682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:34.028400 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-f9560806-6513-4bba-8fa1-ae38bc7069e6 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] 10.222.0.64 "GET /compute/v2.1/servers/36b522b7-9f73-4cbf-b09d-57abc62dc90e" status: 200 len: 1470 microversion: 2.1 time: 0.359487 Jul 19 15:47:34.031013 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 187/336] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:33 2022] GET /compute/v2.1/servers/36b522b7-9f73-4cbf-b09d-57abc62dc90e => generated 1470 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:47:34.283276 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-9cdf9c90-5719-4450-a777-e402505bf938 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:34.294898 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-9cdf9c90-5719-4450-a777-e402505bf938 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/764ab5a7-4ebb-4d76-a34b-5f311883bcbe" status: 200 len: 1521 microversion: 2.1 time: 0.376659 Jul 19 15:47:34.295685 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 150/337] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:33 2022] GET /compute/v2.1/servers/764ab5a7-4ebb-4d76-a34b-5f311883bcbe => generated 1521 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:47:34.463539 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-8138ba34-9326-4864-a236-43959317bbf3 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:34.464125 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-8138ba34-9326-4864-a236-43959317bbf3 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:34.471175 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-8138ba34-9326-4864-a236-43959317bbf3 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:34.473232 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-8138ba34-9326-4864-a236-43959317bbf3 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:34.474253 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-8138ba34-9326-4864-a236-43959317bbf3 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:34.475535 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-8138ba34-9326-4864-a236-43959317bbf3 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:34.515477 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-97e65e75-fb1b-4fd0-a9d7-32cae4f26cc9 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:34.516986 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-97e65e75-fb1b-4fd0-a9d7-32cae4f26cc9 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] [instance: 4157bc30-5973-4e95-a9de-fa467709484e] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:34.528043 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-97e65e75-fb1b-4fd0-a9d7-32cae4f26cc9 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:34.531191 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-97e65e75-fb1b-4fd0-a9d7-32cae4f26cc9 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:34.532022 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-97e65e75-fb1b-4fd0-a9d7-32cae4f26cc9 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:34.534222 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-97e65e75-fb1b-4fd0-a9d7-32cae4f26cc9 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:34.542977 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG dbcounter [-] [129519] Writing DB stats nova_cell1:SELECT=100 {{(pid=129519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:34.662149 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-97e65e75-fb1b-4fd0-a9d7-32cae4f26cc9 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf2b338eac47f6bcf20a48770b2e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41bf5203b925421b9dd2ccc5b7d40ad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:34.698616 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-97e65e75-fb1b-4fd0-a9d7-32cae4f26cc9 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] 10.222.0.64 "GET /compute/v2.1/servers/4157bc30-5973-4e95-a9de-fa467709484e" status: 200 len: 1214 microversion: 2.1 time: 0.176552 Jul 19 15:47:34.701441 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 151/338] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:34 2022] GET /compute/v2.1/servers/4157bc30-5973-4e95-a9de-fa467709484e => generated 1214 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:47:34.718328 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-a909968f-bac7-47f4-a467-e605f55fcdb6 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1191849748", "imageRef": "15012099-fe38-45ac-bd33-d884a5ba65f2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fe8b95ad-7997-4bfd-893e-d87b2c843602"}], "security_groups": [{"name": "tempest-securitygroup--1545699194"}], "key_name": "tempest-keypair-101818663", "user_data": "}} {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:47:34.796338 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-8138ba34-9326-4864-a236-43959317bbf3 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:34.817772 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-8138ba34-9326-4864-a236-43959317bbf3 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:34.820001 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-8138ba34-9326-4864-a236-43959317bbf3 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:34.822606 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-8138ba34-9326-4864-a236-43959317bbf3 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 200 len: 1739 microversion: 2.20 time: 0.363248 Jul 19 15:47:34.827981 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 188/339] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:47:34 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 1739 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:47:34.870467 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [req-4d329e95-e7e7-4b9c-8ca7-4ec4ed16689a req-6f401d9f-3830-49c2-affd-ab230243f2d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "36b522b7-9f73-4cbf-b09d-57abc62dc90e", "name": "network-vif-deleted", "tag": "4ed4f5bc-b69f-4ef0-8f66-4b15b16d0bd7"}]} {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:47:34.884453 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [req-4d329e95-e7e7-4b9c-8ca7-4ec4ed16689a req-6f401d9f-3830-49c2-affd-ab230243f2d4 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:34.884960 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [req-4d329e95-e7e7-4b9c-8ca7-4ec4ed16689a req-6f401d9f-3830-49c2-affd-ab230243f2d4 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:34.889559 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG dbcounter [-] [129520] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:34.899575 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.compute.server_external_events [req-4d329e95-e7e7-4b9c-8ca7-4ec4ed16689a req-6f401d9f-3830-49c2-affd-ab230243f2d4 service nova] Creating event network-vif-deleted:4ed4f5bc-b69f-4ef0-8f66-4b15b16d0bd7 for instance 36b522b7-9f73-4cbf-b09d-57abc62dc90e on hv-cinder-84902 Jul 19 15:47:34.904978 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [req-4d329e95-e7e7-4b9c-8ca7-4ec4ed16689a req-6f401d9f-3830-49c2-affd-ab230243f2d4 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040707 Jul 19 15:47:34.906195 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 189/340] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Jul 19 15:47:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 15:47:35.054391 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-a6998a1e-54de-458b-8786-e8ea5a07fcaf tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:35.055575 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-a6998a1e-54de-458b-8786-e8ea5a07fcaf tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] [instance: 36b522b7-9f73-4cbf-b09d-57abc62dc90e] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:35.066295 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-a6998a1e-54de-458b-8786-e8ea5a07fcaf tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:35.067404 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-a6998a1e-54de-458b-8786-e8ea5a07fcaf tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:35.068404 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-a6998a1e-54de-458b-8786-e8ea5a07fcaf tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:35.068949 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-a6998a1e-54de-458b-8786-e8ea5a07fcaf tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:35.185486 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-a6998a1e-54de-458b-8786-e8ea5a07fcaf tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fdc32c284f7e498e9d53402e73e76c88', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537dfdfbaae043f38cd4300e1b030682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:35.231603 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-a6998a1e-54de-458b-8786-e8ea5a07fcaf tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] 10.222.0.64 "GET /compute/v2.1/servers/36b522b7-9f73-4cbf-b09d-57abc62dc90e" status: 200 len: 1428 microversion: 2.1 time: 0.184361 Jul 19 15:47:35.232229 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 190/341] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:35 2022] GET /compute/v2.1/servers/36b522b7-9f73-4cbf-b09d-57abc62dc90e => generated 1428 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:47:35.324513 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-38f99ed5-670f-4c23-9d26-494aee31f7fd tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:35.325387 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-38f99ed5-670f-4c23-9d26-494aee31f7fd tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 764ab5a7-4ebb-4d76-a34b-5f311883bcbe] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:35.355098 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-38f99ed5-670f-4c23-9d26-494aee31f7fd tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:35.359870 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-38f99ed5-670f-4c23-9d26-494aee31f7fd tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:35.364847 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-38f99ed5-670f-4c23-9d26-494aee31f7fd tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:35.365317 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-38f99ed5-670f-4c23-9d26-494aee31f7fd tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:35.654273 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-38f99ed5-670f-4c23-9d26-494aee31f7fd tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:35.663616 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-38f99ed5-670f-4c23-9d26-494aee31f7fd tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/764ab5a7-4ebb-4d76-a34b-5f311883bcbe" status: 200 len: 1521 microversion: 2.1 time: 0.353785 Jul 19 15:47:35.664639 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 191/342] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:35 2022] GET /compute/v2.1/servers/764ab5a7-4ebb-4d76-a34b-5f311883bcbe => generated 1521 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:47:35.723085 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-1ac46b96-b0de-4d3c-98cb-0214f7842f0a tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:35.724180 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-1ac46b96-b0de-4d3c-98cb-0214f7842f0a tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] [instance: 4157bc30-5973-4e95-a9de-fa467709484e] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:35.751326 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-1ac46b96-b0de-4d3c-98cb-0214f7842f0a tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:35.752312 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-1ac46b96-b0de-4d3c-98cb-0214f7842f0a tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:35.753306 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-1ac46b96-b0de-4d3c-98cb-0214f7842f0a tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:35.754015 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-1ac46b96-b0de-4d3c-98cb-0214f7842f0a tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:36.533911 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-1ac46b96-b0de-4d3c-98cb-0214f7842f0a tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf2b338eac47f6bcf20a48770b2e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41bf5203b925421b9dd2ccc5b7d40ad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:36.542160 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-1ac46b96-b0de-4d3c-98cb-0214f7842f0a tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] 10.222.0.64 "GET /compute/v2.1/servers/4157bc30-5973-4e95-a9de-fa467709484e" status: 200 len: 1270 microversion: 2.1 time: 0.826440 Jul 19 15:47:36.543412 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 192/343] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:35 2022] GET /compute/v2.1/servers/4157bc30-5973-4e95-a9de-fa467709484e => generated 1270 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:47:36.548943 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-1bd0ac07-8064-48f9-a0ac-07f0791c0551 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:36.550140 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-1bd0ac07-8064-48f9-a0ac-07f0791c0551 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:36.556936 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-1bd0ac07-8064-48f9-a0ac-07f0791c0551 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:36.557729 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-1bd0ac07-8064-48f9-a0ac-07f0791c0551 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:36.560989 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-1bd0ac07-8064-48f9-a0ac-07f0791c0551 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:36.561869 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-1bd0ac07-8064-48f9-a0ac-07f0791c0551 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:36.792123 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-1bd0ac07-8064-48f9-a0ac-07f0791c0551 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:36.815844 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-1bd0ac07-8064-48f9-a0ac-07f0791c0551 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:36.821975 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-1bd0ac07-8064-48f9-a0ac-07f0791c0551 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:36.824798 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-1bd0ac07-8064-48f9-a0ac-07f0791c0551 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 200 len: 1739 microversion: 2.20 time: 0.278702 Jul 19 15:47:36.825988 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 193/344] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:47:36 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 1739 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:47:36.832462 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-3df4a9e0-58b7-49bb-8aa8-b205a9c6f059 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:36.833325 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-3df4a9e0-58b7-49bb-8aa8-b205a9c6f059 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] [instance: 36b522b7-9f73-4cbf-b09d-57abc62dc90e] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:36.843416 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-3df4a9e0-58b7-49bb-8aa8-b205a9c6f059 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:36.844436 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-3df4a9e0-58b7-49bb-8aa8-b205a9c6f059 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:36.847167 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-3df4a9e0-58b7-49bb-8aa8-b205a9c6f059 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:36.848066 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-3df4a9e0-58b7-49bb-8aa8-b205a9c6f059 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:36.872423 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.wsgi [None req-3df4a9e0-58b7-49bb-8aa8-b205a9c6f059 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] HTTP exception thrown: Instance 36b522b7-9f73-4cbf-b09d-57abc62dc90e could not be found. Jul 19 15:47:36.874330 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-3df4a9e0-58b7-49bb-8aa8-b205a9c6f059 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Request method failure captured: Jul 19 15:47:36.874330 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: request: GET /compute/v2.1/servers/36b522b7-9f73-4cbf-b09d-57abc62dc90e HTTP/1.1 Jul 19 15:47:36.874330 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Accept: application/json Jul 19 15:47:36.874330 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Accept-Encoding: identity Jul 19 15:47:36.874330 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Connection: close Jul 19 15:47:36.874330 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Content-Length: 0 Jul 19 15:47:36.874330 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Content-Type: application/json Jul 19 15:47:36.874330 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Host: 10.222.0.64 Jul 19 15:47:36.874330 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Openstack-System-Scope: None Jul 19 15:47:36.874330 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: User-Agent: python-urllib3/1.26.9 Jul 19 15:47:36.874330 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Auth-Token: gAAAAABi1tHo_u_1SdebOGGwJ1b8VYBlvZu_K09wUrYvLNbnNnCCVwBKTUo9reciV4y4I3BNUZl3XnCgz0bfxCskHtFKXk0eXwh9n7JDgtMTxv6_tW02-yAdwCNq-uxhBlD8Mv65R27Go965EsoFbHZCRCTHKuVYogxWNvyXcySczCMUjui0YBM Jul 19 15:47:36.874330 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Domain-Id: None Jul 19 15:47:36.874330 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Domain-Name: None Jul 19 15:47:36.874330 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Identity-Status: Confirmed Jul 19 15:47:36.874330 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Is-Admin-Project: True Jul 19 15:47:36.874330 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Project-Domain-Id: default Jul 19 15:47:36.874330 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Project-Domain-Name: Default Jul 19 15:47:36.874330 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Project-Id: 537dfdfbaae043f38cd4300e1b030682 Jul 19 15:47:36.874330 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Project-Name: tempest-VolumesNegativeTest-230751805 Jul 19 15:47:36.874330 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Role: member,reader Jul 19 15:47:36.874330 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Roles: member,reader Jul 19 15:47:36.875916 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_537dfdfbaae043f38cd4300e1b030682", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/537dfdfbaae043f38cd4300e1b030682"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/537dfdfbaae043f38cd4300e1b030682"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/537dfdfbaae043f38cd4300e1b030682"}]}] Jul 19 15:47:36.875916 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Tenant: tempest-VolumesNegativeTest-230751805 Jul 19 15:47:36.875916 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Tenant-Id: 537dfdfbaae043f38cd4300e1b030682 Jul 19 15:47:36.875916 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Tenant-Name: tempest-VolumesNegativeTest-230751805 Jul 19 15:47:36.875916 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User: tempest-VolumesNegativeTest-230751805-project Jul 19 15:47:36.875916 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User-Domain-Id: default Jul 19 15:47:36.875916 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User-Domain-Name: Default Jul 19 15:47:36.875916 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User-Id: fdc32c284f7e498e9d53402e73e76c88 Jul 19 15:47:36.875916 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User-Name: tempest-VolumesNegativeTest-230751805-project Jul 19 15:47:36.875916 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: method: > Jul 19 15:47:36.875916 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: exception: Instance 36b522b7-9f73-4cbf-b09d-57abc62dc90e could not be found. Jul 19 15:47:36.875916 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: action_args: {'id': '36b522b7-9f73-4cbf-b09d-57abc62dc90e'} Jul 19 15:47:36.877810 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:47:36.877810 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:47:36.877810 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 15:47:36.877810 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 15:47:36.877810 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 15:47:36.877810 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 15:47:36.877810 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 15:47:36.877810 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 15:47:36.877810 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 15:47:36.877810 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 15:47:36.877810 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 36b522b7-9f73-4cbf-b09d-57abc62dc90e could not be found. Jul 19 15:47:36.877810 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:47:36.877810 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:47:36.877810 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:47:36.877810 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:47:36.877810 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:47:36.877810 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:47:36.877810 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:47:36.877810 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:47:36.877810 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:47:36.879732 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:47:36.879732 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 15:47:36.879732 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 15:47:36.879732 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 15:47:36.879732 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 15:47:36.879732 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 15:47:36.879732 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 15:47:36.879732 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 36b522b7-9f73-4cbf-b09d-57abc62dc90e could not be found. Jul 19 15:47:36.879732 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:47:36.879732 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:47:36.879732 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:47:36.879732 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:47:36.879732 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:47:36.879732 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:47:36.879732 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:47:36.879732 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:47:36.879732 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 36b522b7-9f73-4cbf-b09d-57abc62dc90e could not be found. Jul 19 15:47:36.879732 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:47:36.881981 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-3df4a9e0-58b7-49bb-8aa8-b205a9c6f059 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] Returning 404 to user: Instance 36b522b7-9f73-4cbf-b09d-57abc62dc90e could not be found. {{(pid=129520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:47:36.883121 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-3df4a9e0-58b7-49bb-8aa8-b205a9c6f059 tempest-VolumesNegativeTest-230751805 tempest-VolumesNegativeTest-230751805-project] 10.222.0.64 "GET /compute/v2.1/servers/36b522b7-9f73-4cbf-b09d-57abc62dc90e" status: 404 len: 111 microversion: 2.1 time: 0.056064 Jul 19 15:47:36.883684 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 194/345] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:36 2022] GET /compute/v2.1/servers/36b522b7-9f73-4cbf-b09d-57abc62dc90e => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 15:47:36.899442 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-4543d735-aaab-4dd3-81fd-116a0dde048f tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:36.900234 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-4543d735-aaab-4dd3-81fd-116a0dde048f tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 764ab5a7-4ebb-4d76-a34b-5f311883bcbe] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:36.906971 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-4543d735-aaab-4dd3-81fd-116a0dde048f tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:36.907691 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-4543d735-aaab-4dd3-81fd-116a0dde048f tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:36.908661 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-4543d735-aaab-4dd3-81fd-116a0dde048f tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:36.909249 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-4543d735-aaab-4dd3-81fd-116a0dde048f tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:37.097757 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-4543d735-aaab-4dd3-81fd-116a0dde048f tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:37.106108 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-4543d735-aaab-4dd3-81fd-116a0dde048f tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/764ab5a7-4ebb-4d76-a34b-5f311883bcbe" status: 200 len: 1501 microversion: 2.1 time: 0.221245 Jul 19 15:47:37.112086 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 195/346] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:36 2022] GET /compute/v2.1/servers/764ab5a7-4ebb-4d76-a34b-5f311883bcbe => generated 1501 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:47:37.131653 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-bd65174c-638a-4a0d-abe1-77b2ee2986ad tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "faf5a0b9-02ee-436c-932e-3e89f37f96ea"}} {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:47:37.132903 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-bd65174c-638a-4a0d-abe1-77b2ee2986ad tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 764ab5a7-4ebb-4d76-a34b-5f311883bcbe] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:37.139481 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-bd65174c-638a-4a0d-abe1-77b2ee2986ad tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:37.140149 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-bd65174c-638a-4a0d-abe1-77b2ee2986ad tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:37.141027 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-bd65174c-638a-4a0d-abe1-77b2ee2986ad tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:37.141598 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-bd65174c-638a-4a0d-abe1-77b2ee2986ad tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:37.180882 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.wsgi [None req-bd65174c-638a-4a0d-abe1-77b2ee2986ad tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] HTTP exception thrown: Cannot 'attach_volume' instance 764ab5a7-4ebb-4d76-a34b-5f311883bcbe while it is in vm_state rescued Jul 19 15:47:37.182789 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-bd65174c-638a-4a0d-abe1-77b2ee2986ad tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Request method failure captured: Jul 19 15:47:37.182789 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: request: POST /compute/v2.1/servers/764ab5a7-4ebb-4d76-a34b-5f311883bcbe/os-volume_attachments HTTP/1.1 Jul 19 15:47:37.182789 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Accept: application/json Jul 19 15:47:37.182789 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Accept-Encoding: identity Jul 19 15:47:37.182789 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Connection: close Jul 19 15:47:37.182789 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Content-Length: 74 Jul 19 15:47:37.182789 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Content-Type: application/json Jul 19 15:47:37.182789 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Host: 10.222.0.64 Jul 19 15:47:37.182789 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Openstack-System-Scope: None Jul 19 15:47:37.182789 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: User-Agent: python-urllib3/1.26.9 Jul 19 15:47:37.182789 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Auth-Token: gAAAAABi1tGPG3TL2GwfAc0kf5LaV9cX4pbJFxTWqQKwJFE5MwZWkdPruymWghvL56VHYnPjmTX00Dxb6n-I5a-K8qDlTUL3Rdjijr9hGViaVz0EvfiTyEi0NIlocc44JNIONZOhLldSNTzzdFWiWGRLTkuRKHFmrDA7ImfJvTM2riB9cOts4j4 Jul 19 15:47:37.182789 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Domain-Id: None Jul 19 15:47:37.182789 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Domain-Name: None Jul 19 15:47:37.182789 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Identity-Status: Confirmed Jul 19 15:47:37.182789 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Is-Admin-Project: True Jul 19 15:47:37.182789 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Project-Domain-Id: default Jul 19 15:47:37.182789 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Project-Domain-Name: Default Jul 19 15:47:37.182789 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Project-Id: a872b4eafae74b82896bd09229152104 Jul 19 15:47:37.182789 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1658676 Jul 19 15:47:37.182789 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Role: member,reader Jul 19 15:47:37.182789 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Roles: member,reader Jul 19 15:47:37.184044 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_a872b4eafae74b82896bd09229152104", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a872b4eafae74b82896bd09229152104"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a872b4eafae74b82896bd09229152104"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/a872b4eafae74b82896bd09229152104"}]}] Jul 19 15:47:37.184044 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1658676 Jul 19 15:47:37.184044 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Tenant-Id: a872b4eafae74b82896bd09229152104 Jul 19 15:47:37.184044 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1658676 Jul 19 15:47:37.184044 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User: tempest-ServerRescueNegativeTestJSON-1658676-project Jul 19 15:47:37.184044 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User-Domain-Id: default Jul 19 15:47:37.184044 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User-Domain-Name: Default Jul 19 15:47:37.184044 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User-Id: 4785719411fd4af892868d99fca7cd71 Jul 19 15:47:37.184044 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1658676-project Jul 19 15:47:37.184044 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Jul 19 15:47:37.184044 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: {"volumeAttachment": {"volumeId": "faf5a0b9-02ee-436c-932e-3e89f37f96ea"}} Jul 19 15:47:37.184044 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: method: > Jul 19 15:47:37.184807 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: exception: Cannot 'attach_volume' instance 764ab5a7-4ebb-4d76-a34b-5f311883bcbe while it is in vm_state rescued Jul 19 15:47:37.184807 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: action_args: {'server_id': '764ab5a7-4ebb-4d76-a34b-5f311883bcbe', 'body': {'volumeAttachment': {'volumeId': 'faf5a0b9-02ee-436c-932e-3e89f37f96ea'}}} Jul 19 15:47:37.184807 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:47:37.184807 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:47:37.184807 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 19 15:47:37.184807 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 19 15:47:37.184807 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 19 15:47:37.184807 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 15:47:37.184807 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 19 15:47:37.184807 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 19 15:47:37.184807 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 764ab5a7-4ebb-4d76-a34b-5f311883bcbe in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 19 15:47:37.184807 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:47:37.184807 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:47:37.184807 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:47:37.184807 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:47:37.184807 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:47:37.184807 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:47:37.184807 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:47:37.184807 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:47:37.185920 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:47:37.185920 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:47:37.185920 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 15:47:37.185920 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 15:47:37.185920 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 15:47:37.185920 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 15:47:37.185920 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 15:47:37.185920 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 15:47:37.185920 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 19 15:47:37.185920 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 19 15:47:37.185920 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 19 15:47:37.185920 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 19 15:47:37.185920 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 764ab5a7-4ebb-4d76-a34b-5f311883bcbe while it is in vm_state rescued Jul 19 15:47:37.185920 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:47:37.185920 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:47:37.185920 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:47:37.185920 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:47:37.185920 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:47:37.185920 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:47:37.187063 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:47:37.187063 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:47:37.187063 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 764ab5a7-4ebb-4d76-a34b-5f311883bcbe while it is in vm_state rescued Jul 19 15:47:37.187063 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:47:37.188950 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-bd65174c-638a-4a0d-abe1-77b2ee2986ad tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Returning 409 to user: Cannot 'attach_volume' instance 764ab5a7-4ebb-4d76-a34b-5f311883bcbe while it is in vm_state rescued {{(pid=129520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:47:37.190266 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-bd65174c-638a-4a0d-abe1-77b2ee2986ad tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "POST /compute/v2.1/servers/764ab5a7-4ebb-4d76-a34b-5f311883bcbe/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.064347 Jul 19 15:47:37.194922 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 196/347] 10.222.0.64 () {60 vars in 1322 bytes} [Tue Jul 19 15:47:37 2022] POST /compute/v2.1/servers/764ab5a7-4ebb-4d76-a34b-5f311883bcbe/os-volume_attachments => generated 152 bytes in 69 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 19 15:47:37.200646 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-b2d7c96c-724b-44de-8c9f-919ee1eef0fe tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:47:37.201541 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-b2d7c96c-724b-44de-8c9f-919ee1eef0fe tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 764ab5a7-4ebb-4d76-a34b-5f311883bcbe] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:37.209384 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b2d7c96c-724b-44de-8c9f-919ee1eef0fe tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:37.210090 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b2d7c96c-724b-44de-8c9f-919ee1eef0fe tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:37.211066 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b2d7c96c-724b-44de-8c9f-919ee1eef0fe tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:37.211663 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b2d7c96c-724b-44de-8c9f-919ee1eef0fe tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:37.324195 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-b2d7c96c-724b-44de-8c9f-919ee1eef0fe tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "POST /compute/v2.1/servers/764ab5a7-4ebb-4d76-a34b-5f311883bcbe/action" status: 202 len: 0 microversion: 2.1 time: 0.124965 Jul 19 15:47:37.331739 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 197/348] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Jul 19 15:47:37 2022] POST /compute/v2.1/servers/764ab5a7-4ebb-4d76-a34b-5f311883bcbe/action => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 15:47:37.337584 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-81161862-b29f-491e-bba9-30acf2e7d399 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:37.338297 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-81161862-b29f-491e-bba9-30acf2e7d399 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 764ab5a7-4ebb-4d76-a34b-5f311883bcbe] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:37.347185 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-81161862-b29f-491e-bba9-30acf2e7d399 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:37.347748 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-81161862-b29f-491e-bba9-30acf2e7d399 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:37.349478 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-81161862-b29f-491e-bba9-30acf2e7d399 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:37.349931 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-81161862-b29f-491e-bba9-30acf2e7d399 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:37.645693 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-81161862-b29f-491e-bba9-30acf2e7d399 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:37.661917 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-81161862-b29f-491e-bba9-30acf2e7d399 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/764ab5a7-4ebb-4d76-a34b-5f311883bcbe" status: 200 len: 1509 microversion: 2.1 time: 0.328196 Jul 19 15:47:37.663436 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 198/349] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:37 2022] GET /compute/v2.1/servers/764ab5a7-4ebb-4d76-a34b-5f311883bcbe => generated 1509 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:47:37.695876 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-abdd6105-847e-4a36-a80f-6c6c3f8548f4 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:37.696754 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-abdd6105-847e-4a36-a80f-6c6c3f8548f4 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] [instance: 4157bc30-5973-4e95-a9de-fa467709484e] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:37.704578 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-abdd6105-847e-4a36-a80f-6c6c3f8548f4 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:37.705023 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-abdd6105-847e-4a36-a80f-6c6c3f8548f4 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:37.717479 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-abdd6105-847e-4a36-a80f-6c6c3f8548f4 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:37.718391 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-abdd6105-847e-4a36-a80f-6c6c3f8548f4 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:37.957901 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-abdd6105-847e-4a36-a80f-6c6c3f8548f4 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf2b338eac47f6bcf20a48770b2e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41bf5203b925421b9dd2ccc5b7d40ad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:37.967362 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-abdd6105-847e-4a36-a80f-6c6c3f8548f4 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] 10.222.0.64 "GET /compute/v2.1/servers/4157bc30-5973-4e95-a9de-fa467709484e" status: 200 len: 1318 microversion: 2.1 time: 0.302334 Jul 19 15:47:37.970916 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 199/350] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:37 2022] GET /compute/v2.1/servers/4157bc30-5973-4e95-a9de-fa467709484e => generated 1318 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:47:37.984758 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-4ed09e52-f9a6-4465-9904-a44f1c76d281 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:37.986393 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-4ed09e52-f9a6-4465-9904-a44f1c76d281 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:37.993863 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-4ed09e52-f9a6-4465-9904-a44f1c76d281 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:37.994498 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-4ed09e52-f9a6-4465-9904-a44f1c76d281 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:37.995383 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-4ed09e52-f9a6-4465-9904-a44f1c76d281 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:37.995966 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-4ed09e52-f9a6-4465-9904-a44f1c76d281 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:38.175394 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-4ed09e52-f9a6-4465-9904-a44f1c76d281 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:38.184225 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-4ed09e52-f9a6-4465-9904-a44f1c76d281 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:38.185867 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-4ed09e52-f9a6-4465-9904-a44f1c76d281 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:38.189019 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-4ed09e52-f9a6-4465-9904-a44f1c76d281 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 200 len: 1739 microversion: 2.20 time: 0.216046 Jul 19 15:47:38.190597 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 200/351] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:47:37 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 1739 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:47:38.688330 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-8bb93902-ddc1-44a0-942e-1418d46a3147 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:38.689531 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-8bb93902-ddc1-44a0-942e-1418d46a3147 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 764ab5a7-4ebb-4d76-a34b-5f311883bcbe] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:38.726648 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-8bb93902-ddc1-44a0-942e-1418d46a3147 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:38.726648 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-8bb93902-ddc1-44a0-942e-1418d46a3147 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:38.726648 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-8bb93902-ddc1-44a0-942e-1418d46a3147 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:38.726648 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-8bb93902-ddc1-44a0-942e-1418d46a3147 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:38.943664 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-8bb93902-ddc1-44a0-942e-1418d46a3147 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:38.953394 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-8bb93902-ddc1-44a0-942e-1418d46a3147 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/764ab5a7-4ebb-4d76-a34b-5f311883bcbe" status: 200 len: 1509 microversion: 2.1 time: 0.276859 Jul 19 15:47:38.961954 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 201/352] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:38 2022] GET /compute/v2.1/servers/764ab5a7-4ebb-4d76-a34b-5f311883bcbe => generated 1509 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:47:38.987154 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-0b3ad50f-2675-4e33-950d-02feb0b4793b tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:38.987917 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-0b3ad50f-2675-4e33-950d-02feb0b4793b tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] [instance: 4157bc30-5973-4e95-a9de-fa467709484e] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:38.993925 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-0b3ad50f-2675-4e33-950d-02feb0b4793b tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:38.994435 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-0b3ad50f-2675-4e33-950d-02feb0b4793b tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:38.995199 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-0b3ad50f-2675-4e33-950d-02feb0b4793b tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:38.995621 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-0b3ad50f-2675-4e33-950d-02feb0b4793b tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:39.177766 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-0b3ad50f-2675-4e33-950d-02feb0b4793b tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf2b338eac47f6bcf20a48770b2e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41bf5203b925421b9dd2ccc5b7d40ad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:39.182694 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-0b3ad50f-2675-4e33-950d-02feb0b4793b tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] 10.222.0.64 "GET /compute/v2.1/servers/4157bc30-5973-4e95-a9de-fa467709484e" status: 200 len: 1318 microversion: 2.1 time: 0.199817 Jul 19 15:47:39.193080 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 202/353] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:38 2022] GET /compute/v2.1/servers/4157bc30-5973-4e95-a9de-fa467709484e => generated 1318 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:47:39.198892 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [req-b8a0397d-170a-485d-a766-5b8695186705 req-d67c00b3-a816-4a48-9543-e3d13c311690 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4157bc30-5973-4e95-a9de-fa467709484e", "tag": "8369d370-1c69-44be-9a5b-cbfe9b7cb0f6"}]} {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:47:39.209674 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [req-b8a0397d-170a-485d-a766-5b8695186705 req-d67c00b3-a816-4a48-9543-e3d13c311690 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:39.210519 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [req-b8a0397d-170a-485d-a766-5b8695186705 req-d67c00b3-a816-4a48-9543-e3d13c311690 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:39.224181 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.compute.server_external_events [req-b8a0397d-170a-485d-a766-5b8695186705 req-d67c00b3-a816-4a48-9543-e3d13c311690 service nova] Creating event network-changed:8369d370-1c69-44be-9a5b-cbfe9b7cb0f6 for instance 4157bc30-5973-4e95-a9de-fa467709484e on hv-cinder-84902 Jul 19 15:47:39.229432 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [req-b8a0397d-170a-485d-a766-5b8695186705 req-d67c00b3-a816-4a48-9543-e3d13c311690 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034032 Jul 19 15:47:39.230586 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 203/354] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Jul 19 15:47:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:47:39.240434 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-00a3f406-bdba-47ac-a082-6d1c81eefb45 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:39.241220 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-00a3f406-bdba-47ac-a082-6d1c81eefb45 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:39.250779 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-00a3f406-bdba-47ac-a082-6d1c81eefb45 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:39.251388 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-00a3f406-bdba-47ac-a082-6d1c81eefb45 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:39.252236 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-00a3f406-bdba-47ac-a082-6d1c81eefb45 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:39.252739 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-00a3f406-bdba-47ac-a082-6d1c81eefb45 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:39.408928 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-00a3f406-bdba-47ac-a082-6d1c81eefb45 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:39.417671 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-00a3f406-bdba-47ac-a082-6d1c81eefb45 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:39.419510 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-00a3f406-bdba-47ac-a082-6d1c81eefb45 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:39.420742 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-00a3f406-bdba-47ac-a082-6d1c81eefb45 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 200 len: 1739 microversion: 2.20 time: 0.189037 Jul 19 15:47:39.421306 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 204/355] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:47:39 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 1739 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:47:39.972259 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-0b7941b8-730f-487b-bd23-1cc4bb372a81 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:39.973072 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-0b7941b8-730f-487b-bd23-1cc4bb372a81 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 764ab5a7-4ebb-4d76-a34b-5f311883bcbe] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:39.980167 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-0b7941b8-730f-487b-bd23-1cc4bb372a81 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:39.980616 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-0b7941b8-730f-487b-bd23-1cc4bb372a81 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:39.981417 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-0b7941b8-730f-487b-bd23-1cc4bb372a81 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:39.981854 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-0b7941b8-730f-487b-bd23-1cc4bb372a81 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:40.150959 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-0b7941b8-730f-487b-bd23-1cc4bb372a81 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:40.160735 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-0b7941b8-730f-487b-bd23-1cc4bb372a81 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/764ab5a7-4ebb-4d76-a34b-5f311883bcbe" status: 200 len: 1509 microversion: 2.1 time: 0.192819 Jul 19 15:47:40.161746 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 205/356] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:39 2022] GET /compute/v2.1/servers/764ab5a7-4ebb-4d76-a34b-5f311883bcbe => generated 1509 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:47:40.205017 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-dd90b34f-7b81-422e-8548-63c789d20a5a tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:40.206296 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-dd90b34f-7b81-422e-8548-63c789d20a5a tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] [instance: 4157bc30-5973-4e95-a9de-fa467709484e] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:40.213115 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-dd90b34f-7b81-422e-8548-63c789d20a5a tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:40.213770 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-dd90b34f-7b81-422e-8548-63c789d20a5a tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:40.214740 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-dd90b34f-7b81-422e-8548-63c789d20a5a tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:40.215328 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-dd90b34f-7b81-422e-8548-63c789d20a5a tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:40.396279 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-dd90b34f-7b81-422e-8548-63c789d20a5a tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf2b338eac47f6bcf20a48770b2e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41bf5203b925421b9dd2ccc5b7d40ad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:40.404232 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-dd90b34f-7b81-422e-8548-63c789d20a5a tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] 10.222.0.64 "GET /compute/v2.1/servers/4157bc30-5973-4e95-a9de-fa467709484e" status: 200 len: 1318 microversion: 2.1 time: 0.207337 Jul 19 15:47:40.405347 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 206/357] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:40 2022] GET /compute/v2.1/servers/4157bc30-5973-4e95-a9de-fa467709484e => generated 1318 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:47:40.442224 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-3d65c33f-3230-4dec-8f7e-25c112082691 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:40.442872 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-3d65c33f-3230-4dec-8f7e-25c112082691 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:40.449313 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-3d65c33f-3230-4dec-8f7e-25c112082691 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:40.449940 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-3d65c33f-3230-4dec-8f7e-25c112082691 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:40.450771 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-3d65c33f-3230-4dec-8f7e-25c112082691 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:40.451215 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-3d65c33f-3230-4dec-8f7e-25c112082691 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:40.458481 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG dbcounter [-] [129520] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:40.631487 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-3d65c33f-3230-4dec-8f7e-25c112082691 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:40.645684 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-3d65c33f-3230-4dec-8f7e-25c112082691 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:40.647459 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-3d65c33f-3230-4dec-8f7e-25c112082691 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:40.650460 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-3d65c33f-3230-4dec-8f7e-25c112082691 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 200 len: 1739 microversion: 2.20 time: 0.212017 Jul 19 15:47:40.650460 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 207/358] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:47:40 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 1739 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 15:47:41.178604 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-1d177983-76c8-4c9f-95a6-30109ee8ae62 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:41.179983 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-1d177983-76c8-4c9f-95a6-30109ee8ae62 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 764ab5a7-4ebb-4d76-a34b-5f311883bcbe] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:41.186964 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-1d177983-76c8-4c9f-95a6-30109ee8ae62 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:41.187671 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-1d177983-76c8-4c9f-95a6-30109ee8ae62 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:41.188731 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-1d177983-76c8-4c9f-95a6-30109ee8ae62 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:41.189900 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-1d177983-76c8-4c9f-95a6-30109ee8ae62 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:41.349147 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-1d177983-76c8-4c9f-95a6-30109ee8ae62 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:41.360637 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-1d177983-76c8-4c9f-95a6-30109ee8ae62 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/764ab5a7-4ebb-4d76-a34b-5f311883bcbe" status: 200 len: 1509 microversion: 2.1 time: 0.185849 Jul 19 15:47:41.375588 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 208/359] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:41 2022] GET /compute/v2.1/servers/764ab5a7-4ebb-4d76-a34b-5f311883bcbe => generated 1509 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:47:41.424893 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-b9449e8f-6a10-4943-8d3d-28238dffa604 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:41.425523 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-b9449e8f-6a10-4943-8d3d-28238dffa604 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] [instance: 4157bc30-5973-4e95-a9de-fa467709484e] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:41.438182 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b9449e8f-6a10-4943-8d3d-28238dffa604 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:41.439123 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b9449e8f-6a10-4943-8d3d-28238dffa604 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:41.440303 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b9449e8f-6a10-4943-8d3d-28238dffa604 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:41.442978 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b9449e8f-6a10-4943-8d3d-28238dffa604 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:41.654811 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-b9449e8f-6a10-4943-8d3d-28238dffa604 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf2b338eac47f6bcf20a48770b2e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41bf5203b925421b9dd2ccc5b7d40ad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:41.664719 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-b9449e8f-6a10-4943-8d3d-28238dffa604 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] 10.222.0.64 "GET /compute/v2.1/servers/4157bc30-5973-4e95-a9de-fa467709484e" status: 200 len: 1318 microversion: 2.1 time: 0.244894 Jul 19 15:47:41.668200 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 209/360] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:41 2022] GET /compute/v2.1/servers/4157bc30-5973-4e95-a9de-fa467709484e => generated 1318 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:47:41.673102 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-1194e20b-080f-451b-a715-1dfa3a9dc1da tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:41.673703 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-1194e20b-080f-451b-a715-1dfa3a9dc1da tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:41.684954 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-1194e20b-080f-451b-a715-1dfa3a9dc1da tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:41.684954 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-1194e20b-080f-451b-a715-1dfa3a9dc1da tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:41.684954 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-1194e20b-080f-451b-a715-1dfa3a9dc1da tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:41.684954 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-1194e20b-080f-451b-a715-1dfa3a9dc1da tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:41.874111 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-1194e20b-080f-451b-a715-1dfa3a9dc1da tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:41.886408 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-1194e20b-080f-451b-a715-1dfa3a9dc1da tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:41.888126 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-1194e20b-080f-451b-a715-1dfa3a9dc1da tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:41.889402 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-1194e20b-080f-451b-a715-1dfa3a9dc1da tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 200 len: 1739 microversion: 2.20 time: 0.220289 Jul 19 15:47:41.890260 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 210/361] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:47:41 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 1739 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:47:42.394149 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-9754a9d3-0137-48ac-96c1-aaf66957aa5d tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:42.396057 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-9754a9d3-0137-48ac-96c1-aaf66957aa5d tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 764ab5a7-4ebb-4d76-a34b-5f311883bcbe] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:42.399191 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG dbcounter [-] [129520] Writing DB stats nova_cell0:SELECT=8 {{(pid=129520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:42.405759 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-9754a9d3-0137-48ac-96c1-aaf66957aa5d tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:42.406208 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-9754a9d3-0137-48ac-96c1-aaf66957aa5d tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:42.407013 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-9754a9d3-0137-48ac-96c1-aaf66957aa5d tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:42.408201 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-9754a9d3-0137-48ac-96c1-aaf66957aa5d tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:42.561151 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-9754a9d3-0137-48ac-96c1-aaf66957aa5d tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:42.569476 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-9754a9d3-0137-48ac-96c1-aaf66957aa5d tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/764ab5a7-4ebb-4d76-a34b-5f311883bcbe" status: 200 len: 1515 microversion: 2.1 time: 0.180615 Jul 19 15:47:42.570564 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 211/362] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:42 2022] GET /compute/v2.1/servers/764ab5a7-4ebb-4d76-a34b-5f311883bcbe => generated 1515 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:47:42.686905 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-4a47a2e5-376a-409e-a339-119e926cf0da tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:42.687862 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-4a47a2e5-376a-409e-a339-119e926cf0da tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] [instance: 4157bc30-5973-4e95-a9de-fa467709484e] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:42.694609 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-4a47a2e5-376a-409e-a339-119e926cf0da tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:42.698668 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-4a47a2e5-376a-409e-a339-119e926cf0da tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:42.699405 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-4a47a2e5-376a-409e-a339-119e926cf0da tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:42.700331 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-4a47a2e5-376a-409e-a339-119e926cf0da tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:42.907790 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-4a47a2e5-376a-409e-a339-119e926cf0da tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf2b338eac47f6bcf20a48770b2e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41bf5203b925421b9dd2ccc5b7d40ad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:42.921711 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-4a47a2e5-376a-409e-a339-119e926cf0da tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] 10.222.0.64 "GET /compute/v2.1/servers/4157bc30-5973-4e95-a9de-fa467709484e" status: 200 len: 1318 microversion: 2.1 time: 0.239485 Jul 19 15:47:42.922420 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 212/363] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:42 2022] GET /compute/v2.1/servers/4157bc30-5973-4e95-a9de-fa467709484e => generated 1318 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:47:42.934895 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-0d1d2840-68cb-4ac8-baf6-cb5bafe5dace tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:42.934895 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-0d1d2840-68cb-4ac8-baf6-cb5bafe5dace tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:42.964363 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-0d1d2840-68cb-4ac8-baf6-cb5bafe5dace tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:42.965029 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-0d1d2840-68cb-4ac8-baf6-cb5bafe5dace tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:42.966559 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-0d1d2840-68cb-4ac8-baf6-cb5bafe5dace tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:42.967648 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-0d1d2840-68cb-4ac8-baf6-cb5bafe5dace tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:43.125882 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-0d1d2840-68cb-4ac8-baf6-cb5bafe5dace tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:43.135138 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-0d1d2840-68cb-4ac8-baf6-cb5bafe5dace tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:43.136796 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-0d1d2840-68cb-4ac8-baf6-cb5bafe5dace tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:43.138061 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-0d1d2840-68cb-4ac8-baf6-cb5bafe5dace tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 200 len: 1739 microversion: 2.20 time: 0.213897 Jul 19 15:47:43.139238 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 213/364] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:47:42 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 1739 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:47:43.263286 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG dbcounter [-] [129519] Writing DB stats nova_cell0:SELECT=2 {{(pid=129519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:43.489515 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG dbcounter [-] [129519] Writing DB stats nova_cell0:SELECT=8 {{(pid=129519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:43.818317 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.network.neutron [None req-a909968f-bac7-47f4-a467-e605f55fcdb6 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] validate_networks() for [('fe8b95ad-7997-4bfd-893e-d87b2c843602', None, None, None, None, None)] {{(pid=129519) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 15:47:43.947022 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-d91d286d-78d7-4447-9635-24abd8d4ce87 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:43.948425 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-d91d286d-78d7-4447-9635-24abd8d4ce87 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] [instance: 4157bc30-5973-4e95-a9de-fa467709484e] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:43.968688 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-d91d286d-78d7-4447-9635-24abd8d4ce87 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:43.969057 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-d91d286d-78d7-4447-9635-24abd8d4ce87 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:43.970573 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-d91d286d-78d7-4447-9635-24abd8d4ce87 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:43.971352 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-d91d286d-78d7-4447-9635-24abd8d4ce87 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:44.190924 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-d91d286d-78d7-4447-9635-24abd8d4ce87 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf2b338eac47f6bcf20a48770b2e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41bf5203b925421b9dd2ccc5b7d40ad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:44.211957 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-d91d286d-78d7-4447-9635-24abd8d4ce87 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] 10.222.0.64 "GET /compute/v2.1/servers/4157bc30-5973-4e95-a9de-fa467709484e" status: 200 len: 1318 microversion: 2.1 time: 0.273604 Jul 19 15:47:44.213275 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 214/365] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:43 2022] GET /compute/v2.1/servers/4157bc30-5973-4e95-a9de-fa467709484e => generated 1318 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:47:44.223109 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-9583bab2-30f0-492b-b58c-bd16c7bd57a6 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Action: 'create', calling method: .version_select at 0x7fb8a64c63a0>, body: {"keypair": {"name": "tempest-keypair-803221286", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBImrT0ThtmA0osmHA3MNg3nOGCZ9XTTMNDeVUMK7fVM5BMqsgm1iNRr6opce8gHuj3vOLk77ZNOKZSrCDwhULZdSy465QVocoCfrReX6uCPbJrCiR7rqdYzQYKAzbtzgvw=="}} {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:47:44.261666 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.quota [None req-9583bab2-30f0-492b-b58c-bd16c7bd57a6 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Getting quotas for project a872b4eafae74b82896bd09229152104. Resources: {'key_pairs'} {{(pid=129520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 15:47:44.267091 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.quota [None req-9583bab2-30f0-492b-b58c-bd16c7bd57a6 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Getting quotas for user 4785719411fd4af892868d99fca7cd71 and project a872b4eafae74b82896bd09229152104. Resources: {'key_pairs'} {{(pid=129520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 15:47:44.308729 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-9583bab2-30f0-492b-b58c-bd16c7bd57a6 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.094137 Jul 19 15:47:44.309745 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 215/366] 10.222.0.64 () {60 vars in 1158 bytes} [Tue Jul 19 15:47:44 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:47:44.314912 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-4fc8744a-6c61-4c4a-91dd-b3f421ad9fe7 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:44.331493 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-4fc8744a-6c61-4c4a-91dd-b3f421ad9fe7 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:44.343415 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-4fc8744a-6c61-4c4a-91dd-b3f421ad9fe7 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:44.344068 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-4fc8744a-6c61-4c4a-91dd-b3f421ad9fe7 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:44.345671 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-4fc8744a-6c61-4c4a-91dd-b3f421ad9fe7 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:44.346448 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-4fc8744a-6c61-4c4a-91dd-b3f421ad9fe7 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:44.403872 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.virt.hardware [None req-a909968f-bac7-47f4-a467-e605f55fcdb6 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Flavor limits 0:0:0 {{(pid=129519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 15:47:44.404521 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.virt.hardware [None req-a909968f-bac7-47f4-a467-e605f55fcdb6 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Image limits 0:0:0 {{(pid=129519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 15:47:44.404863 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.virt.hardware [None req-a909968f-bac7-47f4-a467-e605f55fcdb6 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Flavor pref 0:0:0 {{(pid=129519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 15:47:44.405284 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.virt.hardware [None req-a909968f-bac7-47f4-a467-e605f55fcdb6 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Image pref 0:0:0 {{(pid=129519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 15:47:44.405881 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.virt.hardware [None req-a909968f-bac7-47f4-a467-e605f55fcdb6 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 15:47:44.429163 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-a909968f-bac7-47f4-a467-e605f55fcdb6 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:44.432249 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-a909968f-bac7-47f4-a467-e605f55fcdb6 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:44.437347 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-a909968f-bac7-47f4-a467-e605f55fcdb6 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:44.438068 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-a909968f-bac7-47f4-a467-e605f55fcdb6 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:44.472389 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.quota [None req-a909968f-bac7-47f4-a467-e605f55fcdb6 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Getting quotas for project 45a72d232f314a78b0e1c3f04b0ed682. Resources: {'ram', 'instances', 'cores'} {{(pid=129519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 15:47:44.477705 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.quota [None req-a909968f-bac7-47f4-a467-e605f55fcdb6 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Getting quotas for user 2d7c42cf0bc84292bb0b7edb9f2e7fc3 and project 45a72d232f314a78b0e1c3f04b0ed682. Resources: {'ram', 'instances', 'cores'} {{(pid=129519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 15:47:44.498632 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-a909968f-bac7-47f4-a467-e605f55fcdb6 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Going to run 1 instances... {{(pid=129519) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 15:47:44.501827 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-a909968f-bac7-47f4-a467-e605f55fcdb6 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: 78bc17d6-5509-446d-a843-99a70b397128] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='15012099-fe38-45ac-bd33-d884a5ba65f2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 15:47:44.654160 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-a909968f-bac7-47f4-a467-e605f55fcdb6 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 9.945995 Jul 19 15:47:44.655104 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 152/367] 10.222.0.64 () {60 vars in 1146 bytes} [Tue Jul 19 15:47:34 2022] POST /compute/v2.1/servers => generated 402 bytes in 9953 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 15:47:44.685822 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-b1c4cc5d-c4ec-4251-814c-5c89dcde103e tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:44.686519 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-b1c4cc5d-c4ec-4251-814c-5c89dcde103e tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: 78bc17d6-5509-446d-a843-99a70b397128] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:44.771730 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-b1c4cc5d-c4ec-4251-814c-5c89dcde103e tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7c42cf0bc84292bb0b7edb9f2e7fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a72d232f314a78b0e1c3f04b0ed682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:44.780570 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-b1c4cc5d-c4ec-4251-814c-5c89dcde103e tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/78bc17d6-5509-446d-a843-99a70b397128" status: 200 len: 1241 microversion: 2.1 time: 0.113252 Jul 19 15:47:44.786191 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-4fc8744a-6c61-4c4a-91dd-b3f421ad9fe7 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:44.791480 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 153/368] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:44 2022] GET /compute/v2.1/servers/78bc17d6-5509-446d-a843-99a70b397128 => generated 1241 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:47:44.802072 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-4fc8744a-6c61-4c4a-91dd-b3f421ad9fe7 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:44.810863 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-4fc8744a-6c61-4c4a-91dd-b3f421ad9fe7 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:44.819597 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-4fc8744a-6c61-4c4a-91dd-b3f421ad9fe7 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 200 len: 1739 microversion: 2.20 time: 0.508764 Jul 19 15:47:44.820342 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 216/369] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:47:44 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 1739 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:47:45.232285 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-b197eb29-5324-4d65-a5d4-5c3a69ec9710 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:45.233165 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-b197eb29-5324-4d65-a5d4-5c3a69ec9710 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] [instance: 4157bc30-5973-4e95-a9de-fa467709484e] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:45.251745 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-b197eb29-5324-4d65-a5d4-5c3a69ec9710 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:45.252392 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-b197eb29-5324-4d65-a5d4-5c3a69ec9710 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:45.253238 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-b197eb29-5324-4d65-a5d4-5c3a69ec9710 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:45.257528 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-b197eb29-5324-4d65-a5d4-5c3a69ec9710 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:45.444755 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-b197eb29-5324-4d65-a5d4-5c3a69ec9710 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf2b338eac47f6bcf20a48770b2e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41bf5203b925421b9dd2ccc5b7d40ad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:45.453494 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-b197eb29-5324-4d65-a5d4-5c3a69ec9710 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] 10.222.0.64 "GET /compute/v2.1/servers/4157bc30-5973-4e95-a9de-fa467709484e" status: 200 len: 1318 microversion: 2.1 time: 0.225290 Jul 19 15:47:45.454647 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 154/370] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:45 2022] GET /compute/v2.1/servers/4157bc30-5973-4e95-a9de-fa467709484e => generated 1318 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:47:45.807814 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-36ecc885-c91c-4b7f-acc5-ccfefda899c8 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:45.808464 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-36ecc885-c91c-4b7f-acc5-ccfefda899c8 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: 78bc17d6-5509-446d-a843-99a70b397128] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:45.822115 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-36ecc885-c91c-4b7f-acc5-ccfefda899c8 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:45.822632 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-36ecc885-c91c-4b7f-acc5-ccfefda899c8 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:45.823751 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-36ecc885-c91c-4b7f-acc5-ccfefda899c8 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:45.824053 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-36ecc885-c91c-4b7f-acc5-ccfefda899c8 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:45.839995 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-984e2378-8849-442d-9f41-082deb3bb23a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:45.841292 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-984e2378-8849-442d-9f41-082deb3bb23a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:45.863266 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-984e2378-8849-442d-9f41-082deb3bb23a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:45.864967 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-984e2378-8849-442d-9f41-082deb3bb23a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:45.866836 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-984e2378-8849-442d-9f41-082deb3bb23a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:45.868227 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-984e2378-8849-442d-9f41-082deb3bb23a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:45.933327 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-36ecc885-c91c-4b7f-acc5-ccfefda899c8 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7c42cf0bc84292bb0b7edb9f2e7fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a72d232f314a78b0e1c3f04b0ed682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:45.951565 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-36ecc885-c91c-4b7f-acc5-ccfefda899c8 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/78bc17d6-5509-446d-a843-99a70b397128" status: 200 len: 1293 microversion: 2.1 time: 0.147778 Jul 19 15:47:45.952153 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 217/371] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:45 2022] GET /compute/v2.1/servers/78bc17d6-5509-446d-a843-99a70b397128 => generated 1293 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:47:46.127831 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-984e2378-8849-442d-9f41-082deb3bb23a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:46.142727 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-984e2378-8849-442d-9f41-082deb3bb23a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:46.149528 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-984e2378-8849-442d-9f41-082deb3bb23a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:46.150785 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-984e2378-8849-442d-9f41-082deb3bb23a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 200 len: 1739 microversion: 2.20 time: 0.315070 Jul 19 15:47:46.151352 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 155/372] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:47:45 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 1739 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:47:46.475720 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-43c860fb-1734-4940-94c8-6740bf65254c tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:46.477756 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-43c860fb-1734-4940-94c8-6740bf65254c tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] [instance: 4157bc30-5973-4e95-a9de-fa467709484e] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:46.491993 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-43c860fb-1734-4940-94c8-6740bf65254c tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:46.492746 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-43c860fb-1734-4940-94c8-6740bf65254c tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:46.493828 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-43c860fb-1734-4940-94c8-6740bf65254c tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:46.494536 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-43c860fb-1734-4940-94c8-6740bf65254c tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:46.701664 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-43c860fb-1734-4940-94c8-6740bf65254c tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf2b338eac47f6bcf20a48770b2e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41bf5203b925421b9dd2ccc5b7d40ad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:46.713071 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-43c860fb-1734-4940-94c8-6740bf65254c tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] 10.222.0.64 "GET /compute/v2.1/servers/4157bc30-5973-4e95-a9de-fa467709484e" status: 200 len: 1318 microversion: 2.1 time: 0.244544 Jul 19 15:47:46.714307 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 218/373] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:46 2022] GET /compute/v2.1/servers/4157bc30-5973-4e95-a9de-fa467709484e => generated 1318 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:47:46.968499 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-7e11640f-c983-441f-9e4c-bc406851c155 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:46.969108 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-7e11640f-c983-441f-9e4c-bc406851c155 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: 78bc17d6-5509-446d-a843-99a70b397128] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:46.982001 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-7e11640f-c983-441f-9e4c-bc406851c155 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:46.982708 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-7e11640f-c983-441f-9e4c-bc406851c155 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:46.983662 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-7e11640f-c983-441f-9e4c-bc406851c155 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:46.986502 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-7e11640f-c983-441f-9e4c-bc406851c155 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:47.100463 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-7e11640f-c983-441f-9e4c-bc406851c155 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7c42cf0bc84292bb0b7edb9f2e7fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a72d232f314a78b0e1c3f04b0ed682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:47.108336 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-2b3c3281-d161-4bfd-ac48-0418d1ce003a tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1131576185", "imageRef": "15012099-fe38-45ac-bd33-d884a5ba65f2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8dcc6647-13fc-4b32-9768-cee1a56fe5f7"}], "security_groups": [{"name": "tempest-securitygroup--1917148118"}], "key_name": "tempest-keypair-803221286", "user_data": "}} {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:47:47.131965 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-7e11640f-c983-441f-9e4c-bc406851c155 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/78bc17d6-5509-446d-a843-99a70b397128" status: 200 len: 1299 microversion: 2.1 time: 0.167127 Jul 19 15:47:47.132841 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 156/374] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:46 2022] GET /compute/v2.1/servers/78bc17d6-5509-446d-a843-99a70b397128 => generated 1299 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:47:47.170397 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-efd4c35b-1c10-4ff7-8214-c29db8cd673f tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:47.171788 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-efd4c35b-1c10-4ff7-8214-c29db8cd673f tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:47.179559 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-efd4c35b-1c10-4ff7-8214-c29db8cd673f tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:47.180231 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-efd4c35b-1c10-4ff7-8214-c29db8cd673f tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:47.181418 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-efd4c35b-1c10-4ff7-8214-c29db8cd673f tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:47.182021 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-efd4c35b-1c10-4ff7-8214-c29db8cd673f tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:47.360268 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.network.neutron [None req-2b3c3281-d161-4bfd-ac48-0418d1ce003a tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] validate_networks() for [('8dcc6647-13fc-4b32-9768-cee1a56fe5f7', None, None, None, None, None)] {{(pid=129520) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 15:47:47.419406 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-efd4c35b-1c10-4ff7-8214-c29db8cd673f tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:47.435259 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-efd4c35b-1c10-4ff7-8214-c29db8cd673f tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:47.437223 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-efd4c35b-1c10-4ff7-8214-c29db8cd673f tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:47.440229 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-efd4c35b-1c10-4ff7-8214-c29db8cd673f tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 200 len: 1739 microversion: 2.20 time: 0.273680 Jul 19 15:47:47.443604 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 157/375] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:47:47 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 1739 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:47:47.732163 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-b9a6671b-dfcc-47f7-96b0-052db48711a8 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:47.732772 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-b9a6671b-dfcc-47f7-96b0-052db48711a8 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] [instance: 4157bc30-5973-4e95-a9de-fa467709484e] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:47.743414 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-b9a6671b-dfcc-47f7-96b0-052db48711a8 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:47.743865 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-b9a6671b-dfcc-47f7-96b0-052db48711a8 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:47.748407 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-b9a6671b-dfcc-47f7-96b0-052db48711a8 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:47.749526 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-b9a6671b-dfcc-47f7-96b0-052db48711a8 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:47.931373 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.virt.hardware [None req-2b3c3281-d161-4bfd-ac48-0418d1ce003a tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Flavor limits 0:0:0 {{(pid=129520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 15:47:47.931958 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.virt.hardware [None req-2b3c3281-d161-4bfd-ac48-0418d1ce003a tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Image limits 0:0:0 {{(pid=129520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 15:47:47.932573 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.virt.hardware [None req-2b3c3281-d161-4bfd-ac48-0418d1ce003a tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Flavor pref 0:0:0 {{(pid=129520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 15:47:47.933150 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.virt.hardware [None req-2b3c3281-d161-4bfd-ac48-0418d1ce003a tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Image pref 0:0:0 {{(pid=129520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 15:47:47.933883 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.virt.hardware [None req-2b3c3281-d161-4bfd-ac48-0418d1ce003a tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 15:47:47.945415 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-2b3c3281-d161-4bfd-ac48-0418d1ce003a tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:47.946063 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-2b3c3281-d161-4bfd-ac48-0418d1ce003a tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:47.947187 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-2b3c3281-d161-4bfd-ac48-0418d1ce003a tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:47.947818 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-2b3c3281-d161-4bfd-ac48-0418d1ce003a tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:47.972095 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.quota [None req-2b3c3281-d161-4bfd-ac48-0418d1ce003a tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Getting quotas for project a872b4eafae74b82896bd09229152104. Resources: {'ram', 'instances', 'cores'} {{(pid=129520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 15:47:47.978514 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.quota [None req-2b3c3281-d161-4bfd-ac48-0418d1ce003a tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Getting quotas for user 4785719411fd4af892868d99fca7cd71 and project a872b4eafae74b82896bd09229152104. Resources: {'ram', 'instances', 'cores'} {{(pid=129520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 15:47:47.991899 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-2b3c3281-d161-4bfd-ac48-0418d1ce003a tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Going to run 1 instances... {{(pid=129520) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 15:47:47.994664 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-2b3c3281-d161-4bfd-ac48-0418d1ce003a tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 0194ecf2-5e08-49b2-a4e9-185bf9b32e40] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='15012099-fe38-45ac-bd33-d884a5ba65f2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 15:47:48.057493 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-2b3c3281-d161-4bfd-ac48-0418d1ce003a tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.953274 Jul 19 15:47:48.058264 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 219/376] 10.222.0.64 () {60 vars in 1146 bytes} [Tue Jul 19 15:47:47 2022] POST /compute/v2.1/servers => generated 409 bytes in 955 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 15:47:48.070001 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-43622c1d-28b5-4074-8783-3594aabdb8c2 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:48.070792 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-43622c1d-28b5-4074-8783-3594aabdb8c2 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 0194ecf2-5e08-49b2-a4e9-185bf9b32e40] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:48.072842 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG dbcounter [-] [129520] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=129520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:48.192859 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-43622c1d-28b5-4074-8783-3594aabdb8c2 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:48.208712 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-43622c1d-28b5-4074-8783-3594aabdb8c2 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40" status: 200 len: 1245 microversion: 2.1 time: 0.138901 Jul 19 15:47:48.209120 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 220/377] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:48 2022] GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40 => generated 1245 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:47:48.215922 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-a8202981-ed04-4d07-962e-31b5cd21f0e6 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:48.216798 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-a8202981-ed04-4d07-962e-31b5cd21f0e6 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: 78bc17d6-5509-446d-a843-99a70b397128] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:48.225277 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-a8202981-ed04-4d07-962e-31b5cd21f0e6 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:48.226090 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-a8202981-ed04-4d07-962e-31b5cd21f0e6 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:48.227132 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-a8202981-ed04-4d07-962e-31b5cd21f0e6 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:48.227775 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-a8202981-ed04-4d07-962e-31b5cd21f0e6 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:48.405219 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-a8202981-ed04-4d07-962e-31b5cd21f0e6 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7c42cf0bc84292bb0b7edb9f2e7fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a72d232f314a78b0e1c3f04b0ed682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:48.415737 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-a8202981-ed04-4d07-962e-31b5cd21f0e6 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/78bc17d6-5509-446d-a843-99a70b397128" status: 200 len: 1367 microversion: 2.1 time: 0.205070 Jul 19 15:47:48.416502 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 221/378] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:48 2022] GET /compute/v2.1/servers/78bc17d6-5509-446d-a843-99a70b397128 => generated 1367 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:47:48.462908 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-4aa26e0a-39b4-48b4-a61d-87cc15ed41ba tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:48.464071 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-4aa26e0a-39b4-48b4-a61d-87cc15ed41ba tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:48.474188 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-b9a6671b-dfcc-47f7-96b0-052db48711a8 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf2b338eac47f6bcf20a48770b2e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41bf5203b925421b9dd2ccc5b7d40ad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:48.474828 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-4aa26e0a-39b4-48b4-a61d-87cc15ed41ba tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:48.474934 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-4aa26e0a-39b4-48b4-a61d-87cc15ed41ba tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:48.476087 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-4aa26e0a-39b4-48b4-a61d-87cc15ed41ba tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:48.476735 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-4aa26e0a-39b4-48b4-a61d-87cc15ed41ba tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:48.483280 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-b9a6671b-dfcc-47f7-96b0-052db48711a8 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] 10.222.0.64 "GET /compute/v2.1/servers/4157bc30-5973-4e95-a9de-fa467709484e" status: 200 len: 1318 microversion: 2.1 time: 0.755792 Jul 19 15:47:48.488341 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 158/379] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:47 2022] GET /compute/v2.1/servers/4157bc30-5973-4e95-a9de-fa467709484e => generated 1318 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:47:48.660695 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-4aa26e0a-39b4-48b4-a61d-87cc15ed41ba tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:48.673805 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-4aa26e0a-39b4-48b4-a61d-87cc15ed41ba tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:48.675915 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-4aa26e0a-39b4-48b4-a61d-87cc15ed41ba tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:48.678261 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-4aa26e0a-39b4-48b4-a61d-87cc15ed41ba tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 200 len: 1721 microversion: 2.20 time: 0.220232 Jul 19 15:47:48.679910 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 222/380] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:47:48 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 1721 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 15:47:48.897175 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [req-29eb6b12-1b10-4123-99cc-b1f9eae463bd req-97a0e7ed-8f7e-40e8-a17f-95cb95cbb622 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4157bc30-5973-4e95-a9de-fa467709484e", "name": "network-vif-plugged", "status": "completed", "tag": "8369d370-1c69-44be-9a5b-cbfe9b7cb0f6"}]} {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:47:48.906072 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [req-29eb6b12-1b10-4123-99cc-b1f9eae463bd req-97a0e7ed-8f7e-40e8-a17f-95cb95cbb622 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:48.906884 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [req-29eb6b12-1b10-4123-99cc-b1f9eae463bd req-97a0e7ed-8f7e-40e8-a17f-95cb95cbb622 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:48.922595 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.compute.server_external_events [req-29eb6b12-1b10-4123-99cc-b1f9eae463bd req-97a0e7ed-8f7e-40e8-a17f-95cb95cbb622 service nova] Creating event network-vif-plugged:8369d370-1c69-44be-9a5b-cbfe9b7cb0f6 for instance 4157bc30-5973-4e95-a9de-fa467709484e on hv-cinder-84902 Jul 19 15:47:48.928793 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [req-29eb6b12-1b10-4123-99cc-b1f9eae463bd req-97a0e7ed-8f7e-40e8-a17f-95cb95cbb622 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035303 Jul 19 15:47:48.929396 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 159/381] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Jul 19 15:47:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:47:49.211845 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [req-1157811b-70b5-452f-9bfb-6a3cf2a4e4ab req-fff161ee-f2f7-419f-8596-d0931e4d2e08 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78bc17d6-5509-446d-a843-99a70b397128", "tag": "41689fce-682e-44b2-a26f-83d31eb3790b"}]} {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:47:49.228916 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-a73f403f-2830-4504-9896-00728e6022ab tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:49.229626 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-a73f403f-2830-4504-9896-00728e6022ab tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 0194ecf2-5e08-49b2-a4e9-185bf9b32e40] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:49.232348 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [req-1157811b-70b5-452f-9bfb-6a3cf2a4e4ab req-fff161ee-f2f7-419f-8596-d0931e4d2e08 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:49.233934 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [req-1157811b-70b5-452f-9bfb-6a3cf2a4e4ab req-fff161ee-f2f7-419f-8596-d0931e4d2e08 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:49.245116 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-a73f403f-2830-4504-9896-00728e6022ab tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:49.245572 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-a73f403f-2830-4504-9896-00728e6022ab tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:49.246384 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-a73f403f-2830-4504-9896-00728e6022ab tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:49.246828 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-a73f403f-2830-4504-9896-00728e6022ab tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:49.254547 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.compute.server_external_events [req-1157811b-70b5-452f-9bfb-6a3cf2a4e4ab req-fff161ee-f2f7-419f-8596-d0931e4d2e08 service nova] Creating event network-changed:41689fce-682e-44b2-a26f-83d31eb3790b for instance 78bc17d6-5509-446d-a843-99a70b397128 on hv-cinder-84902 Jul 19 15:47:49.259465 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [req-1157811b-70b5-452f-9bfb-6a3cf2a4e4ab req-fff161ee-f2f7-419f-8596-d0931e4d2e08 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054042 Jul 19 15:47:49.260681 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 223/382] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Jul 19 15:47:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:47:49.398981 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-a73f403f-2830-4504-9896-00728e6022ab tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:49.416069 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-a73f403f-2830-4504-9896-00728e6022ab tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40" status: 200 len: 1297 microversion: 2.1 time: 0.192786 Jul 19 15:47:49.418947 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 160/383] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:49 2022] GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40 => generated 1297 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:47:49.437590 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-c43294a7-9f0d-4964-8925-c1f27875ac9d tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:49.439248 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-c43294a7-9f0d-4964-8925-c1f27875ac9d tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: 78bc17d6-5509-446d-a843-99a70b397128] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:49.450293 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-c43294a7-9f0d-4964-8925-c1f27875ac9d tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:49.450798 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-c43294a7-9f0d-4964-8925-c1f27875ac9d tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:49.451633 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-c43294a7-9f0d-4964-8925-c1f27875ac9d tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:49.452070 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-c43294a7-9f0d-4964-8925-c1f27875ac9d tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:49.506941 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-9391b75b-2d41-4279-ac9f-678ed2502c99 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:49.508688 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-9391b75b-2d41-4279-ac9f-678ed2502c99 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] [instance: 4157bc30-5973-4e95-a9de-fa467709484e] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:49.518674 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-9391b75b-2d41-4279-ac9f-678ed2502c99 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:49.519522 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-9391b75b-2d41-4279-ac9f-678ed2502c99 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:49.520495 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-9391b75b-2d41-4279-ac9f-678ed2502c99 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:49.521214 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-9391b75b-2d41-4279-ac9f-678ed2502c99 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:49.636969 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-c43294a7-9f0d-4964-8925-c1f27875ac9d tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7c42cf0bc84292bb0b7edb9f2e7fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a72d232f314a78b0e1c3f04b0ed682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:49.645206 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-c43294a7-9f0d-4964-8925-c1f27875ac9d tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/78bc17d6-5509-446d-a843-99a70b397128" status: 200 len: 1367 microversion: 2.1 time: 0.212247 Jul 19 15:47:49.646416 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 224/384] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:49 2022] GET /compute/v2.1/servers/78bc17d6-5509-446d-a843-99a70b397128 => generated 1367 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:47:49.699332 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-7f598eac-f9ff-49de-9f61-bc24ed92b121 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:49.700056 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-7f598eac-f9ff-49de-9f61-bc24ed92b121 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:49.708167 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-7f598eac-f9ff-49de-9f61-bc24ed92b121 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:49.708866 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-7f598eac-f9ff-49de-9f61-bc24ed92b121 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:49.710044 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-7f598eac-f9ff-49de-9f61-bc24ed92b121 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:49.710728 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-7f598eac-f9ff-49de-9f61-bc24ed92b121 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:49.760550 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-9391b75b-2d41-4279-ac9f-678ed2502c99 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf2b338eac47f6bcf20a48770b2e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41bf5203b925421b9dd2ccc5b7d40ad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:49.769849 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-9391b75b-2d41-4279-ac9f-678ed2502c99 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] 10.222.0.64 "GET /compute/v2.1/servers/4157bc30-5973-4e95-a9de-fa467709484e" status: 200 len: 1318 microversion: 2.1 time: 0.269513 Jul 19 15:47:49.770728 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 161/385] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:49 2022] GET /compute/v2.1/servers/4157bc30-5973-4e95-a9de-fa467709484e => generated 1318 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:47:49.851798 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-7f598eac-f9ff-49de-9f61-bc24ed92b121 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:49.860160 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-7f598eac-f9ff-49de-9f61-bc24ed92b121 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:49.861820 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-7f598eac-f9ff-49de-9f61-bc24ed92b121 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:49.863002 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-7f598eac-f9ff-49de-9f61-bc24ed92b121 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 200 len: 1721 microversion: 2.20 time: 0.168637 Jul 19 15:47:49.863567 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 225/386] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:47:49 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 1721 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:47:50.435971 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-a5b49925-d538-4062-b6c5-9e4046abeea5 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:50.436669 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-a5b49925-d538-4062-b6c5-9e4046abeea5 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 0194ecf2-5e08-49b2-a4e9-185bf9b32e40] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:50.444692 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-a5b49925-d538-4062-b6c5-9e4046abeea5 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:50.445248 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-a5b49925-d538-4062-b6c5-9e4046abeea5 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:50.446070 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-a5b49925-d538-4062-b6c5-9e4046abeea5 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:50.446702 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-a5b49925-d538-4062-b6c5-9e4046abeea5 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:50.517037 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-a5b49925-d538-4062-b6c5-9e4046abeea5 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:50.524895 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-a5b49925-d538-4062-b6c5-9e4046abeea5 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40" status: 200 len: 1315 microversion: 2.1 time: 0.092462 Jul 19 15:47:50.525445 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 162/387] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:50 2022] GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40 => generated 1315 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:47:50.662623 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-2abf13a3-5453-426a-9409-0fede7997571 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:50.663523 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-2abf13a3-5453-426a-9409-0fede7997571 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: 78bc17d6-5509-446d-a843-99a70b397128] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:50.675451 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-2abf13a3-5453-426a-9409-0fede7997571 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:50.675988 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-2abf13a3-5453-426a-9409-0fede7997571 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:50.676817 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-2abf13a3-5453-426a-9409-0fede7997571 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:50.677349 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-2abf13a3-5453-426a-9409-0fede7997571 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:50.793248 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-6b79df12-89f3-47b9-a86b-f2e077c2a0a1 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:50.794233 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-6b79df12-89f3-47b9-a86b-f2e077c2a0a1 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] [instance: 4157bc30-5973-4e95-a9de-fa467709484e] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:50.802592 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-6b79df12-89f3-47b9-a86b-f2e077c2a0a1 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:50.803355 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-6b79df12-89f3-47b9-a86b-f2e077c2a0a1 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:50.804439 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-6b79df12-89f3-47b9-a86b-f2e077c2a0a1 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:50.805131 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-6b79df12-89f3-47b9-a86b-f2e077c2a0a1 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:50.853860 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-2abf13a3-5453-426a-9409-0fede7997571 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7c42cf0bc84292bb0b7edb9f2e7fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a72d232f314a78b0e1c3f04b0ed682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:50.868734 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-2abf13a3-5453-426a-9409-0fede7997571 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/78bc17d6-5509-446d-a843-99a70b397128" status: 200 len: 1367 microversion: 2.1 time: 0.210206 Jul 19 15:47:50.869597 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 226/388] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:50 2022] GET /compute/v2.1/servers/78bc17d6-5509-446d-a843-99a70b397128 => generated 1367 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:47:50.884496 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-d4602d12-769a-4283-b9ed-c09f112d86f1 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-993511218", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-701832674", "security_groups": [{"name": "tempest-secgroup-smoke-1743401924"}], "block_device_mapping_v2": [{"uuid": "9455a5c0-ff22-42f9-8391-abf6a43dbbad", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "195064b7-2168-479c-96ce-505c1a5c25ea"}]}} {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:47:50.958857 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-6b79df12-89f3-47b9-a86b-f2e077c2a0a1 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf2b338eac47f6bcf20a48770b2e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41bf5203b925421b9dd2ccc5b7d40ad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:50.966688 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-6b79df12-89f3-47b9-a86b-f2e077c2a0a1 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] 10.222.0.64 "GET /compute/v2.1/servers/4157bc30-5973-4e95-a9de-fa467709484e" status: 200 len: 1318 microversion: 2.1 time: 0.182963 Jul 19 15:47:50.967478 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 163/389] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:50 2022] GET /compute/v2.1/servers/4157bc30-5973-4e95-a9de-fa467709484e => generated 1318 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:47:50.972990 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-6b3b4f69-9d28-40bd-b608-5f9662911c0a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:50.973884 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-6b3b4f69-9d28-40bd-b608-5f9662911c0a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:50.980333 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-6b3b4f69-9d28-40bd-b608-5f9662911c0a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:50.980775 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-6b3b4f69-9d28-40bd-b608-5f9662911c0a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:50.981529 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-6b3b4f69-9d28-40bd-b608-5f9662911c0a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:50.981953 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-6b3b4f69-9d28-40bd-b608-5f9662911c0a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:51.020107 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.network.neutron [None req-d4602d12-769a-4283-b9ed-c09f112d86f1 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] validate_networks() for [('195064b7-2168-479c-96ce-505c1a5c25ea', None, None, None, None, None)] {{(pid=129520) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 15:47:51.213012 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-6b3b4f69-9d28-40bd-b608-5f9662911c0a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:51.228762 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-6b3b4f69-9d28-40bd-b608-5f9662911c0a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:51.231941 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-6b3b4f69-9d28-40bd-b608-5f9662911c0a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:51.234482 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-6b3b4f69-9d28-40bd-b608-5f9662911c0a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 200 len: 1721 microversion: 2.20 time: 0.265506 Jul 19 15:47:51.235638 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 164/390] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:47:50 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 1721 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:47:51.543591 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-742b2a44-5f71-4886-a1d6-b4141ecd76da tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:51.545013 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-742b2a44-5f71-4886-a1d6-b4141ecd76da tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 0194ecf2-5e08-49b2-a4e9-185bf9b32e40] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:51.553279 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-742b2a44-5f71-4886-a1d6-b4141ecd76da tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:51.553966 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-742b2a44-5f71-4886-a1d6-b4141ecd76da tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:51.554939 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-742b2a44-5f71-4886-a1d6-b4141ecd76da tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:51.555433 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-742b2a44-5f71-4886-a1d6-b4141ecd76da tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:51.628455 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-742b2a44-5f71-4886-a1d6-b4141ecd76da tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:51.635905 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-742b2a44-5f71-4886-a1d6-b4141ecd76da tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40" status: 200 len: 1303 microversion: 2.1 time: 0.096439 Jul 19 15:47:51.636465 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 165/391] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:51 2022] GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40 => generated 1303 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:47:51.688902 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.virt.hardware [None req-d4602d12-769a-4283-b9ed-c09f112d86f1 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Flavor limits 0:0:0 {{(pid=129520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 15:47:51.689599 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.virt.hardware [None req-d4602d12-769a-4283-b9ed-c09f112d86f1 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Image limits 0:0:0 {{(pid=129520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 15:47:51.690144 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.virt.hardware [None req-d4602d12-769a-4283-b9ed-c09f112d86f1 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Flavor pref 0:0:0 {{(pid=129520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 15:47:51.690819 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.virt.hardware [None req-d4602d12-769a-4283-b9ed-c09f112d86f1 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Image pref 0:0:0 {{(pid=129520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 15:47:51.691300 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.virt.hardware [None req-d4602d12-769a-4283-b9ed-c09f112d86f1 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 15:47:51.701086 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-d4602d12-769a-4283-b9ed-c09f112d86f1 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:51.701612 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-d4602d12-769a-4283-b9ed-c09f112d86f1 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:51.702496 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-d4602d12-769a-4283-b9ed-c09f112d86f1 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:51.702996 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-d4602d12-769a-4283-b9ed-c09f112d86f1 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:51.710489 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG dbcounter [-] [129520] Writing DB stats nova_cell1:SELECT=100 {{(pid=129520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:51.722265 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.quota [None req-d4602d12-769a-4283-b9ed-c09f112d86f1 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Getting quotas for project 6827afcdf1f3481882f808dc01908a4d. Resources: {'ram', 'instances', 'cores'} {{(pid=129520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 15:47:51.726274 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.quota [None req-d4602d12-769a-4283-b9ed-c09f112d86f1 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Getting quotas for user ae334c4d93cd4d3e94789a5985fcfa77 and project 6827afcdf1f3481882f808dc01908a4d. Resources: {'ram', 'instances', 'cores'} {{(pid=129520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 15:47:51.789725 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-d4602d12-769a-4283-b9ed-c09f112d86f1 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Going to run 1 instances... {{(pid=129520) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 15:47:51.791802 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-d4602d12-769a-4283-b9ed-c09f112d86f1 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] [instance: 17f9fd89-e668-4d3d-8d85-e648189ba0c2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9455a5c0-ff22-42f9-8391-abf6a43dbbad',volume_size=None,volume_type=None)] {{(pid=129520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 15:47:51.885590 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-82173651-8bfc-4858-a059-0413d01f4af5 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:51.886202 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-82173651-8bfc-4858-a059-0413d01f4af5 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: 78bc17d6-5509-446d-a843-99a70b397128] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:51.892832 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-82173651-8bfc-4858-a059-0413d01f4af5 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:51.893518 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-82173651-8bfc-4858-a059-0413d01f4af5 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:51.894306 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-82173651-8bfc-4858-a059-0413d01f4af5 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:51.894759 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-82173651-8bfc-4858-a059-0413d01f4af5 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:51.932894 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-d4602d12-769a-4283-b9ed-c09f112d86f1 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.062178 Jul 19 15:47:51.933644 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 227/392] 10.222.0.64 () {60 vars in 1146 bytes} [Tue Jul 19 15:47:50 2022] POST /compute/v2.1/servers => generated 406 bytes in 1063 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 15:47:51.943818 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-1ad4993b-759c-4053-8109-2d18a6552924 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:51.944418 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-1ad4993b-759c-4053-8109-2d18a6552924 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] [instance: 17f9fd89-e668-4d3d-8d85-e648189ba0c2] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:52.080622 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-1ad4993b-759c-4053-8109-2d18a6552924 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae334c4d93cd4d3e94789a5985fcfa77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6827afcdf1f3481882f808dc01908a4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:52.096295 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-1ad4993b-759c-4053-8109-2d18a6552924 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] 10.222.0.64 "GET /compute/v2.1/servers/17f9fd89-e668-4d3d-8d85-e648189ba0c2" status: 200 len: 1093 microversion: 2.1 time: 0.154704 Jul 19 15:47:52.098182 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 228/393] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:51 2022] GET /compute/v2.1/servers/17f9fd89-e668-4d3d-8d85-e648189ba0c2 => generated 1093 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:47:52.109639 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-82173651-8bfc-4858-a059-0413d01f4af5 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7c42cf0bc84292bb0b7edb9f2e7fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a72d232f314a78b0e1c3f04b0ed682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:52.119967 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-82173651-8bfc-4858-a059-0413d01f4af5 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/78bc17d6-5509-446d-a843-99a70b397128" status: 200 len: 1367 microversion: 2.1 time: 0.238019 Jul 19 15:47:52.122667 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 166/394] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:51 2022] GET /compute/v2.1/servers/78bc17d6-5509-446d-a843-99a70b397128 => generated 1367 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:47:52.144791 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-d8fa654d-4b57-47af-9869-ff9e6042da11 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:52.146532 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-d8fa654d-4b57-47af-9869-ff9e6042da11 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] [instance: 4157bc30-5973-4e95-a9de-fa467709484e] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:52.154424 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-d8fa654d-4b57-47af-9869-ff9e6042da11 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:52.154905 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-d8fa654d-4b57-47af-9869-ff9e6042da11 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:52.155750 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-d8fa654d-4b57-47af-9869-ff9e6042da11 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:52.156220 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-d8fa654d-4b57-47af-9869-ff9e6042da11 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:52.255521 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-2e91f428-51e1-40fc-b882-baaf31ede111 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:52.256030 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-2e91f428-51e1-40fc-b882-baaf31ede111 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:52.263267 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-2e91f428-51e1-40fc-b882-baaf31ede111 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:52.264691 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-2e91f428-51e1-40fc-b882-baaf31ede111 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:52.265644 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-2e91f428-51e1-40fc-b882-baaf31ede111 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:52.266626 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-2e91f428-51e1-40fc-b882-baaf31ede111 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:52.418698 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-d8fa654d-4b57-47af-9869-ff9e6042da11 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf2b338eac47f6bcf20a48770b2e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41bf5203b925421b9dd2ccc5b7d40ad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:52.428680 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-d8fa654d-4b57-47af-9869-ff9e6042da11 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] 10.222.0.64 "GET /compute/v2.1/servers/4157bc30-5973-4e95-a9de-fa467709484e" status: 200 len: 1318 microversion: 2.1 time: 0.297070 Jul 19 15:47:52.430728 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 229/395] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:52 2022] GET /compute/v2.1/servers/4157bc30-5973-4e95-a9de-fa467709484e => generated 1318 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:47:52.576805 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-2e91f428-51e1-40fc-b882-baaf31ede111 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:52.590787 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-2e91f428-51e1-40fc-b882-baaf31ede111 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:52.593427 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-2e91f428-51e1-40fc-b882-baaf31ede111 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:52.596341 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-2e91f428-51e1-40fc-b882-baaf31ede111 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 200 len: 1664 microversion: 2.20 time: 0.346429 Jul 19 15:47:52.597078 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 167/396] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:47:52 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 1664 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 15:47:52.614534 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-1d19d11b-f8d4-4ddd-9e39-72695c862ccc tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1067a5c6-39c8-46c6-b2e5-3d08ca2ec4ce"}} {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:47:52.615734 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-1d19d11b-f8d4-4ddd-9e39-72695c862ccc tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:52.622281 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-1d19d11b-f8d4-4ddd-9e39-72695c862ccc tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:52.622751 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-1d19d11b-f8d4-4ddd-9e39-72695c862ccc tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:52.623514 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-1d19d11b-f8d4-4ddd-9e39-72695c862ccc tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:52.623942 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-1d19d11b-f8d4-4ddd-9e39-72695c862ccc tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:52.653854 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-35f70a90-7855-4747-b8e5-344fefdce233 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:52.654800 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-35f70a90-7855-4747-b8e5-344fefdce233 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 0194ecf2-5e08-49b2-a4e9-185bf9b32e40] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:52.662969 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-35f70a90-7855-4747-b8e5-344fefdce233 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:52.663706 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-35f70a90-7855-4747-b8e5-344fefdce233 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:52.664792 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-35f70a90-7855-4747-b8e5-344fefdce233 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:52.665678 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-35f70a90-7855-4747-b8e5-344fefdce233 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:52.927058 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-35f70a90-7855-4747-b8e5-344fefdce233 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:52.948098 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-35f70a90-7855-4747-b8e5-344fefdce233 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40" status: 200 len: 1371 microversion: 2.1 time: 0.298681 Jul 19 15:47:52.948782 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 168/397] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:52 2022] GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40 => generated 1371 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:47:53.005511 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [req-f5706d91-eb5c-405d-b509-c85a3f055a8a req-35d625d6-8826-41ab-b47a-c5ff0e5af087 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3eeb4a51-a06c-4faf-9a63-bf3658ca773b", "name": "network-vif-unplugged", "status": "completed", "tag": "61483d93-6fa5-46d1-b820-a274f98ffcbb"}]} {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:47:53.021580 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [req-f5706d91-eb5c-405d-b509-c85a3f055a8a req-35d625d6-8826-41ab-b47a-c5ff0e5af087 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:53.022244 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [req-f5706d91-eb5c-405d-b509-c85a3f055a8a req-35d625d6-8826-41ab-b47a-c5ff0e5af087 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:53.057675 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.compute.server_external_events [req-f5706d91-eb5c-405d-b509-c85a3f055a8a req-35d625d6-8826-41ab-b47a-c5ff0e5af087 service nova] Unable to find a host for instance 3eeb4a51-a06c-4faf-9a63-bf3658ca773b. Dropping event network-vif-unplugged {{(pid=129519) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jul 19 15:47:53.058623 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [req-f5706d91-eb5c-405d-b509-c85a3f055a8a req-35d625d6-8826-41ab-b47a-c5ff0e5af087 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.057472 Jul 19 15:47:53.063052 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 169/398] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Jul 19 15:47:52 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 61 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Jul 19 15:47:53.072605 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [req-b5254430-5216-4bdf-ab5a-62b59fd920bd req-a164bb7f-c6b9-40dd-b5ee-96c7dbf7335c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0194ecf2-5e08-49b2-a4e9-185bf9b32e40", "tag": "588a9a7a-f29d-40a2-abf8-161404100f96"}]} {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:47:53.091343 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [req-b5254430-5216-4bdf-ab5a-62b59fd920bd req-a164bb7f-c6b9-40dd-b5ee-96c7dbf7335c service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:53.095872 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [req-b5254430-5216-4bdf-ab5a-62b59fd920bd req-a164bb7f-c6b9-40dd-b5ee-96c7dbf7335c service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:53.127745 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.compute.server_external_events [req-b5254430-5216-4bdf-ab5a-62b59fd920bd req-a164bb7f-c6b9-40dd-b5ee-96c7dbf7335c service nova] Creating event network-changed:588a9a7a-f29d-40a2-abf8-161404100f96 for instance 0194ecf2-5e08-49b2-a4e9-185bf9b32e40 on hv-cinder-84902 Jul 19 15:47:53.133495 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [req-b5254430-5216-4bdf-ab5a-62b59fd920bd req-a164bb7f-c6b9-40dd-b5ee-96c7dbf7335c service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066615 Jul 19 15:47:53.134681 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 170/399] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Jul 19 15:47:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:47:53.154560 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-feee593d-d7b3-421f-b6cd-13b65961331a tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:53.164811 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-feee593d-d7b3-421f-b6cd-13b65961331a tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] [instance: 17f9fd89-e668-4d3d-8d85-e648189ba0c2] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:53.181417 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-feee593d-d7b3-421f-b6cd-13b65961331a tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:53.182980 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-feee593d-d7b3-421f-b6cd-13b65961331a tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:53.184221 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-feee593d-d7b3-421f-b6cd-13b65961331a tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:53.184955 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-feee593d-d7b3-421f-b6cd-13b65961331a tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:53.190127 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-1d19d11b-f8d4-4ddd-9e39-72695c862ccc tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "POST /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.579950 Jul 19 15:47:53.190877 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 230/400] 10.222.0.64 () {62 vars in 1363 bytes} [Tue Jul 19 15:47:52 2022] POST /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b/os-volume_attachments => generated 188 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 19 15:47:53.202817 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-59c89f97-3a25-4bc9-8f39-29e8346d97a6 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:53.205562 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-59c89f97-3a25-4bc9-8f39-29e8346d97a6 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: 78bc17d6-5509-446d-a843-99a70b397128] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:53.214730 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG dbcounter [-] [129519] Writing DB stats nova_cell1:SELECT=100 {{(pid=129519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:53.220038 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-59c89f97-3a25-4bc9-8f39-29e8346d97a6 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:53.222956 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-59c89f97-3a25-4bc9-8f39-29e8346d97a6 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:53.224972 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-59c89f97-3a25-4bc9-8f39-29e8346d97a6 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:53.225591 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-59c89f97-3a25-4bc9-8f39-29e8346d97a6 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:53.286189 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-feee593d-d7b3-421f-b6cd-13b65961331a tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae334c4d93cd4d3e94789a5985fcfa77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6827afcdf1f3481882f808dc01908a4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:53.294615 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-feee593d-d7b3-421f-b6cd-13b65961331a tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] 10.222.0.64 "GET /compute/v2.1/servers/17f9fd89-e668-4d3d-8d85-e648189ba0c2" status: 200 len: 1143 microversion: 2.1 time: 0.150403 Jul 19 15:47:53.295227 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 171/401] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:53 2022] GET /compute/v2.1/servers/17f9fd89-e668-4d3d-8d85-e648189ba0c2 => generated 1143 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:47:53.329354 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-e4096253-6059-4ea0-9c52-55cf24750733 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:47:53.329967 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-e4096253-6059-4ea0-9c52-55cf24750733 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:53.336450 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-e4096253-6059-4ea0-9c52-55cf24750733 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:53.336950 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-e4096253-6059-4ea0-9c52-55cf24750733 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:53.337811 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-e4096253-6059-4ea0-9c52-55cf24750733 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:53.338282 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-e4096253-6059-4ea0-9c52-55cf24750733 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:53.391359 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-59c89f97-3a25-4bc9-8f39-29e8346d97a6 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7c42cf0bc84292bb0b7edb9f2e7fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a72d232f314a78b0e1c3f04b0ed682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:53.399551 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-59c89f97-3a25-4bc9-8f39-29e8346d97a6 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/78bc17d6-5509-446d-a843-99a70b397128" status: 200 len: 1367 microversion: 2.1 time: 0.202897 Jul 19 15:47:53.400127 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 231/402] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:53 2022] GET /compute/v2.1/servers/78bc17d6-5509-446d-a843-99a70b397128 => generated 1367 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:47:53.445941 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-e4096253-6059-4ea0-9c52-55cf24750733 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "POST /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b/action" status: 202 len: 0 microversion: 2.20 time: 0.120586 Jul 19 15:47:53.446738 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 172/403] 10.222.0.64 () {62 vars in 1318 bytes} [Tue Jul 19 15:47:53 2022] POST /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 19 15:47:53.447170 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-b07c1e1a-d708-497a-a752-c8cfb431f4ea tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:53.447773 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-b07c1e1a-d708-497a-a752-c8cfb431f4ea tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] [instance: 4157bc30-5973-4e95-a9de-fa467709484e] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:53.453841 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b07c1e1a-d708-497a-a752-c8cfb431f4ea tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:53.454332 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b07c1e1a-d708-497a-a752-c8cfb431f4ea tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:53.454748 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-a2601912-d404-4254-835a-546248f272b5 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:53.455345 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b07c1e1a-d708-497a-a752-c8cfb431f4ea tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:53.455456 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-a2601912-d404-4254-835a-546248f272b5 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:53.455779 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b07c1e1a-d708-497a-a752-c8cfb431f4ea tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:53.461406 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-a2601912-d404-4254-835a-546248f272b5 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:53.461857 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-a2601912-d404-4254-835a-546248f272b5 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:53.462653 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-a2601912-d404-4254-835a-546248f272b5 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:53.463118 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-a2601912-d404-4254-835a-546248f272b5 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:53.595971 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-b07c1e1a-d708-497a-a752-c8cfb431f4ea tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf2b338eac47f6bcf20a48770b2e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41bf5203b925421b9dd2ccc5b7d40ad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:53.603661 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-b07c1e1a-d708-497a-a752-c8cfb431f4ea tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] 10.222.0.64 "GET /compute/v2.1/servers/4157bc30-5973-4e95-a9de-fa467709484e" status: 200 len: 1506 microversion: 2.1 time: 0.160352 Jul 19 15:47:53.604245 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 232/404] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:53 2022] GET /compute/v2.1/servers/4157bc30-5973-4e95-a9de-fa467709484e => generated 1506 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:47:53.622516 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-a2601912-d404-4254-835a-546248f272b5 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:53.631936 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-a2601912-d404-4254-835a-546248f272b5 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:53.633443 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-a2601912-d404-4254-835a-546248f272b5 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:53.635002 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-a2601912-d404-4254-835a-546248f272b5 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 200 len: 1750 microversion: 2.20 time: 0.184179 Jul 19 15:47:53.635629 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 173/405] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:47:53 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 1750 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 15:47:53.968511 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-3c98d4de-565a-4fd7-9913-11f6e72056b7 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:53.969358 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-3c98d4de-565a-4fd7-9913-11f6e72056b7 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 0194ecf2-5e08-49b2-a4e9-185bf9b32e40] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:53.978739 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-3c98d4de-565a-4fd7-9913-11f6e72056b7 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:53.979419 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-3c98d4de-565a-4fd7-9913-11f6e72056b7 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:53.980442 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-3c98d4de-565a-4fd7-9913-11f6e72056b7 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:53.981084 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-3c98d4de-565a-4fd7-9913-11f6e72056b7 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:54.156431 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-3c98d4de-565a-4fd7-9913-11f6e72056b7 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:54.165133 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-3c98d4de-565a-4fd7-9913-11f6e72056b7 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40" status: 200 len: 1371 microversion: 2.1 time: 0.201744 Jul 19 15:47:54.165708 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 233/406] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:53 2022] GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40 => generated 1371 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:47:54.312046 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-c63a6fe9-3161-4682-bf70-c8938c2c091d tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:54.312573 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-c63a6fe9-3161-4682-bf70-c8938c2c091d tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] [instance: 17f9fd89-e668-4d3d-8d85-e648189ba0c2] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:54.319237 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-c63a6fe9-3161-4682-bf70-c8938c2c091d tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:54.319686 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-c63a6fe9-3161-4682-bf70-c8938c2c091d tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:54.320468 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-c63a6fe9-3161-4682-bf70-c8938c2c091d tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:54.320902 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-c63a6fe9-3161-4682-bf70-c8938c2c091d tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:54.388171 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-c63a6fe9-3161-4682-bf70-c8938c2c091d tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae334c4d93cd4d3e94789a5985fcfa77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6827afcdf1f3481882f808dc01908a4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:54.396705 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-c63a6fe9-3161-4682-bf70-c8938c2c091d tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] 10.222.0.64 "GET /compute/v2.1/servers/17f9fd89-e668-4d3d-8d85-e648189ba0c2" status: 200 len: 1143 microversion: 2.1 time: 0.088681 Jul 19 15:47:54.397266 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 174/407] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:54 2022] GET /compute/v2.1/servers/17f9fd89-e668-4d3d-8d85-e648189ba0c2 => generated 1143 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:47:54.417262 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-0ad56e00-5a21-451d-9ae5-a03462393c2d tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:54.417865 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-0ad56e00-5a21-451d-9ae5-a03462393c2d tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: 78bc17d6-5509-446d-a843-99a70b397128] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:54.424005 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-0ad56e00-5a21-451d-9ae5-a03462393c2d tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:54.424454 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-0ad56e00-5a21-451d-9ae5-a03462393c2d tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:54.425212 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-0ad56e00-5a21-451d-9ae5-a03462393c2d tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:54.425635 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-0ad56e00-5a21-451d-9ae5-a03462393c2d tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:54.560144 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-0ad56e00-5a21-451d-9ae5-a03462393c2d tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7c42cf0bc84292bb0b7edb9f2e7fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a72d232f314a78b0e1c3f04b0ed682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:54.568449 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-0ad56e00-5a21-451d-9ae5-a03462393c2d tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/78bc17d6-5509-446d-a843-99a70b397128" status: 200 len: 1367 microversion: 2.1 time: 0.154994 Jul 19 15:47:54.568947 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 234/408] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:54 2022] GET /compute/v2.1/servers/78bc17d6-5509-446d-a843-99a70b397128 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:47:54.653624 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-835c50f4-d84f-42a0-887c-d7e216432713 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:54.654225 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-835c50f4-d84f-42a0-887c-d7e216432713 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:54.656076 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG dbcounter [-] [129519] Writing DB stats nova_cell0:SELECT=2 {{(pid=129519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:54.662633 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-835c50f4-d84f-42a0-887c-d7e216432713 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:54.663076 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-835c50f4-d84f-42a0-887c-d7e216432713 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:54.663826 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-835c50f4-d84f-42a0-887c-d7e216432713 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:54.664252 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-835c50f4-d84f-42a0-887c-d7e216432713 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:54.776674 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG dbcounter [-] [129519] Writing DB stats nova_cell0:SELECT=8 {{(pid=129519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:54.791591 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-835c50f4-d84f-42a0-887c-d7e216432713 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:54.799813 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-835c50f4-d84f-42a0-887c-d7e216432713 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:54.801297 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-835c50f4-d84f-42a0-887c-d7e216432713 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:54.802453 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-835c50f4-d84f-42a0-887c-d7e216432713 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 200 len: 1750 microversion: 2.20 time: 0.152735 Jul 19 15:47:54.803003 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 175/409] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:47:54 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 1750 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:47:55.188646 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-f0869a26-a21f-48a6-99c6-abd4129cac1e tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:55.189255 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-f0869a26-a21f-48a6-99c6-abd4129cac1e tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 0194ecf2-5e08-49b2-a4e9-185bf9b32e40] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:55.195781 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-f0869a26-a21f-48a6-99c6-abd4129cac1e tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:55.196229 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-f0869a26-a21f-48a6-99c6-abd4129cac1e tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:55.196986 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-f0869a26-a21f-48a6-99c6-abd4129cac1e tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:55.197423 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-f0869a26-a21f-48a6-99c6-abd4129cac1e tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:55.329701 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-f0869a26-a21f-48a6-99c6-abd4129cac1e tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:55.337359 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-f0869a26-a21f-48a6-99c6-abd4129cac1e tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40" status: 200 len: 1371 microversion: 2.1 time: 0.152703 Jul 19 15:47:55.337922 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 235/410] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:55 2022] GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40 => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:47:55.413841 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-75c4da2a-a501-4bf5-910b-94c7ce0d4197 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:55.414481 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-75c4da2a-a501-4bf5-910b-94c7ce0d4197 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] [instance: 17f9fd89-e668-4d3d-8d85-e648189ba0c2] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:55.420509 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-75c4da2a-a501-4bf5-910b-94c7ce0d4197 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:55.420960 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-75c4da2a-a501-4bf5-910b-94c7ce0d4197 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:55.421723 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-75c4da2a-a501-4bf5-910b-94c7ce0d4197 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:55.422158 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-75c4da2a-a501-4bf5-910b-94c7ce0d4197 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:55.481664 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-75c4da2a-a501-4bf5-910b-94c7ce0d4197 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae334c4d93cd4d3e94789a5985fcfa77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6827afcdf1f3481882f808dc01908a4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:55.489732 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-75c4da2a-a501-4bf5-910b-94c7ce0d4197 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] 10.222.0.64 "GET /compute/v2.1/servers/17f9fd89-e668-4d3d-8d85-e648189ba0c2" status: 200 len: 1143 microversion: 2.1 time: 0.080046 Jul 19 15:47:55.490302 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 176/411] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:55 2022] GET /compute/v2.1/servers/17f9fd89-e668-4d3d-8d85-e648189ba0c2 => generated 1143 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:47:55.585572 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-a07b991c-73e0-41b0-a98b-ed779361b588 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:55.586182 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-a07b991c-73e0-41b0-a98b-ed779361b588 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: 78bc17d6-5509-446d-a843-99a70b397128] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:55.592272 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-a07b991c-73e0-41b0-a98b-ed779361b588 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:55.592750 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-a07b991c-73e0-41b0-a98b-ed779361b588 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:55.593511 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-a07b991c-73e0-41b0-a98b-ed779361b588 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:55.593944 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-a07b991c-73e0-41b0-a98b-ed779361b588 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:55.821662 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-4ffc5111-ba79-4513-8b09-ccef22b67b79 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:55.822558 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-4ffc5111-ba79-4513-8b09-ccef22b67b79 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:55.829478 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-4ffc5111-ba79-4513-8b09-ccef22b67b79 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:55.830132 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-4ffc5111-ba79-4513-8b09-ccef22b67b79 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:55.831070 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-4ffc5111-ba79-4513-8b09-ccef22b67b79 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:55.831492 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-4ffc5111-ba79-4513-8b09-ccef22b67b79 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:55.982736 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-4ffc5111-ba79-4513-8b09-ccef22b67b79 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:55.989437 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-a07b991c-73e0-41b0-a98b-ed779361b588 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7c42cf0bc84292bb0b7edb9f2e7fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a72d232f314a78b0e1c3f04b0ed682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:55.991766 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-4ffc5111-ba79-4513-8b09-ccef22b67b79 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:55.993358 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-4ffc5111-ba79-4513-8b09-ccef22b67b79 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:55.994663 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-4ffc5111-ba79-4513-8b09-ccef22b67b79 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 200 len: 1750 microversion: 2.20 time: 0.177514 Jul 19 15:47:55.995304 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 177/412] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:47:55 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 1750 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:47:55.996895 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-a07b991c-73e0-41b0-a98b-ed779361b588 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/78bc17d6-5509-446d-a843-99a70b397128" status: 200 len: 1367 microversion: 2.1 time: 0.415205 Jul 19 15:47:55.997541 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 236/413] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:55 2022] GET /compute/v2.1/servers/78bc17d6-5509-446d-a843-99a70b397128 => generated 1367 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:47:56.354520 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-985882aa-ddaf-424f-8b72-6fa169ba7f1c tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:56.355150 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-985882aa-ddaf-424f-8b72-6fa169ba7f1c tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 0194ecf2-5e08-49b2-a4e9-185bf9b32e40] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:56.361997 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-985882aa-ddaf-424f-8b72-6fa169ba7f1c tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:56.362551 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-985882aa-ddaf-424f-8b72-6fa169ba7f1c tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:56.363259 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-985882aa-ddaf-424f-8b72-6fa169ba7f1c tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:56.363699 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-985882aa-ddaf-424f-8b72-6fa169ba7f1c tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:56.496788 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-985882aa-ddaf-424f-8b72-6fa169ba7f1c tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:56.504806 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-985882aa-ddaf-424f-8b72-6fa169ba7f1c tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40" status: 200 len: 1371 microversion: 2.1 time: 0.154112 Jul 19 15:47:56.505384 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 178/414] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:56 2022] GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40 => generated 1371 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:47:56.506620 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-33e23f88-43a9-4b34-80dd-cdbf7df1cd01 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:56.507231 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-33e23f88-43a9-4b34-80dd-cdbf7df1cd01 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] [instance: 17f9fd89-e668-4d3d-8d85-e648189ba0c2] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:56.514093 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-33e23f88-43a9-4b34-80dd-cdbf7df1cd01 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:56.514572 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-33e23f88-43a9-4b34-80dd-cdbf7df1cd01 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:56.515354 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-33e23f88-43a9-4b34-80dd-cdbf7df1cd01 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:56.515909 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-33e23f88-43a9-4b34-80dd-cdbf7df1cd01 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:56.578692 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-33e23f88-43a9-4b34-80dd-cdbf7df1cd01 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae334c4d93cd4d3e94789a5985fcfa77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6827afcdf1f3481882f808dc01908a4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:56.586813 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-33e23f88-43a9-4b34-80dd-cdbf7df1cd01 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] 10.222.0.64 "GET /compute/v2.1/servers/17f9fd89-e668-4d3d-8d85-e648189ba0c2" status: 200 len: 1135 microversion: 2.1 time: 0.084134 Jul 19 15:47:56.587374 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 237/415] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:56 2022] GET /compute/v2.1/servers/17f9fd89-e668-4d3d-8d85-e648189ba0c2 => generated 1135 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:47:57.014000 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-812dc7d1-9732-46f5-9336-13021091f85a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:57.014237 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-f7c1671f-a7d4-4c39-b012-d9f215f84d7a tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:57.014969 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-f7c1671f-a7d4-4c39-b012-d9f215f84d7a tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: 78bc17d6-5509-446d-a843-99a70b397128] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:57.016044 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-812dc7d1-9732-46f5-9336-13021091f85a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:57.029409 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-f7c1671f-a7d4-4c39-b012-d9f215f84d7a tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:57.032832 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-f7c1671f-a7d4-4c39-b012-d9f215f84d7a tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:57.033956 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-f7c1671f-a7d4-4c39-b012-d9f215f84d7a tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:57.035043 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-812dc7d1-9732-46f5-9336-13021091f85a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:57.035585 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-812dc7d1-9732-46f5-9336-13021091f85a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:57.035786 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-f7c1671f-a7d4-4c39-b012-d9f215f84d7a tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:57.036402 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-812dc7d1-9732-46f5-9336-13021091f85a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:57.037165 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-812dc7d1-9732-46f5-9336-13021091f85a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:57.261583 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-f7c1671f-a7d4-4c39-b012-d9f215f84d7a tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7c42cf0bc84292bb0b7edb9f2e7fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a72d232f314a78b0e1c3f04b0ed682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:57.269886 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-f7c1671f-a7d4-4c39-b012-d9f215f84d7a tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/78bc17d6-5509-446d-a843-99a70b397128" status: 200 len: 1367 microversion: 2.1 time: 0.259933 Jul 19 15:47:57.272090 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 179/416] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:57 2022] GET /compute/v2.1/servers/78bc17d6-5509-446d-a843-99a70b397128 => generated 1367 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:47:57.312887 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-812dc7d1-9732-46f5-9336-13021091f85a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:57.322221 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-812dc7d1-9732-46f5-9336-13021091f85a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:57.323768 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-812dc7d1-9732-46f5-9336-13021091f85a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:57.324923 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-812dc7d1-9732-46f5-9336-13021091f85a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 200 len: 1750 microversion: 2.20 time: 0.314910 Jul 19 15:47:57.325480 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 238/417] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:47:57 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 1750 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:47:57.521844 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-8368bbe4-021d-41c7-8719-381a9661311a tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:57.522621 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-8368bbe4-021d-41c7-8719-381a9661311a tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 0194ecf2-5e08-49b2-a4e9-185bf9b32e40] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:57.529943 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-8368bbe4-021d-41c7-8719-381a9661311a tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:57.530415 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-8368bbe4-021d-41c7-8719-381a9661311a tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:57.531446 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-8368bbe4-021d-41c7-8719-381a9661311a tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:57.532180 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-8368bbe4-021d-41c7-8719-381a9661311a tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:57.604530 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-f4693e61-0ec7-499c-8cc0-edca2723f9d4 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:57.605237 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-f4693e61-0ec7-499c-8cc0-edca2723f9d4 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] [instance: 17f9fd89-e668-4d3d-8d85-e648189ba0c2] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:57.613360 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-f4693e61-0ec7-499c-8cc0-edca2723f9d4 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:57.613810 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-f4693e61-0ec7-499c-8cc0-edca2723f9d4 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:57.622070 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-f4693e61-0ec7-499c-8cc0-edca2723f9d4 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:57.622562 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-f4693e61-0ec7-499c-8cc0-edca2723f9d4 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:57.715449 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-f4693e61-0ec7-499c-8cc0-edca2723f9d4 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae334c4d93cd4d3e94789a5985fcfa77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6827afcdf1f3481882f808dc01908a4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:57.724700 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-f4693e61-0ec7-499c-8cc0-edca2723f9d4 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] 10.222.0.64 "GET /compute/v2.1/servers/17f9fd89-e668-4d3d-8d85-e648189ba0c2" status: 200 len: 1199 microversion: 2.1 time: 0.124785 Jul 19 15:47:57.725281 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 239/418] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:57 2022] GET /compute/v2.1/servers/17f9fd89-e668-4d3d-8d85-e648189ba0c2 => generated 1199 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:47:57.787509 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-8368bbe4-021d-41c7-8719-381a9661311a tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:57.795563 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-8368bbe4-021d-41c7-8719-381a9661311a tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40" status: 200 len: 1371 microversion: 2.1 time: 0.277582 Jul 19 15:47:57.806085 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 180/419] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:57 2022] GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40 => generated 1371 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:47:58.287871 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-ef192f4d-56b0-4da3-8afe-28fa12e98b6c tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:58.288624 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-ef192f4d-56b0-4da3-8afe-28fa12e98b6c tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: 78bc17d6-5509-446d-a843-99a70b397128] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:58.295425 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-ef192f4d-56b0-4da3-8afe-28fa12e98b6c tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:58.295790 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-ef192f4d-56b0-4da3-8afe-28fa12e98b6c tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:58.296630 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-ef192f4d-56b0-4da3-8afe-28fa12e98b6c tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:58.297142 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-ef192f4d-56b0-4da3-8afe-28fa12e98b6c tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:58.345247 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-939e7d8b-9abf-4f21-b94e-9ce64049b923 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:58.345874 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-939e7d8b-9abf-4f21-b94e-9ce64049b923 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:58.352336 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-939e7d8b-9abf-4f21-b94e-9ce64049b923 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:58.352778 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-939e7d8b-9abf-4f21-b94e-9ce64049b923 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:58.353527 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-939e7d8b-9abf-4f21-b94e-9ce64049b923 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:58.353951 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-939e7d8b-9abf-4f21-b94e-9ce64049b923 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:58.441557 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-ef192f4d-56b0-4da3-8afe-28fa12e98b6c tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7c42cf0bc84292bb0b7edb9f2e7fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a72d232f314a78b0e1c3f04b0ed682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:58.449676 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-ef192f4d-56b0-4da3-8afe-28fa12e98b6c tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/78bc17d6-5509-446d-a843-99a70b397128" status: 200 len: 1367 microversion: 2.1 time: 0.166244 Jul 19 15:47:58.450343 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 240/420] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:58 2022] GET /compute/v2.1/servers/78bc17d6-5509-446d-a843-99a70b397128 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:47:58.489989 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-939e7d8b-9abf-4f21-b94e-9ce64049b923 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:58.498875 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-939e7d8b-9abf-4f21-b94e-9ce64049b923 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:58.500543 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-939e7d8b-9abf-4f21-b94e-9ce64049b923 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:58.502426 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-939e7d8b-9abf-4f21-b94e-9ce64049b923 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 200 len: 1752 microversion: 2.20 time: 0.161777 Jul 19 15:47:58.502991 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 181/421] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:47:58 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 1752 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 15:47:58.742429 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-d1e42906-a0a4-4ec5-a361-111beb5c7c7d tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:58.743057 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-d1e42906-a0a4-4ec5-a361-111beb5c7c7d tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] [instance: 17f9fd89-e668-4d3d-8d85-e648189ba0c2] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:58.749525 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-d1e42906-a0a4-4ec5-a361-111beb5c7c7d tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:58.749972 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-d1e42906-a0a4-4ec5-a361-111beb5c7c7d tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:58.751356 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-d1e42906-a0a4-4ec5-a361-111beb5c7c7d tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:58.751798 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-d1e42906-a0a4-4ec5-a361-111beb5c7c7d tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:58.814056 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-36956169-6fb1-4d81-a21c-da08651bff69 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:58.815136 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-36956169-6fb1-4d81-a21c-da08651bff69 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 0194ecf2-5e08-49b2-a4e9-185bf9b32e40] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:58.817948 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-d1e42906-a0a4-4ec5-a361-111beb5c7c7d tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae334c4d93cd4d3e94789a5985fcfa77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6827afcdf1f3481882f808dc01908a4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:58.821564 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-36956169-6fb1-4d81-a21c-da08651bff69 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:58.822114 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-36956169-6fb1-4d81-a21c-da08651bff69 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:58.823057 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-36956169-6fb1-4d81-a21c-da08651bff69 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:58.823583 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-36956169-6fb1-4d81-a21c-da08651bff69 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:58.825371 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-d1e42906-a0a4-4ec5-a361-111beb5c7c7d tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] 10.222.0.64 "GET /compute/v2.1/servers/17f9fd89-e668-4d3d-8d85-e648189ba0c2" status: 200 len: 1209 microversion: 2.1 time: 0.086853 Jul 19 15:47:58.825944 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 241/422] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:58 2022] GET /compute/v2.1/servers/17f9fd89-e668-4d3d-8d85-e648189ba0c2 => generated 1209 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:47:59.083340 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-36956169-6fb1-4d81-a21c-da08651bff69 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:59.093788 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-36956169-6fb1-4d81-a21c-da08651bff69 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40" status: 200 len: 1371 microversion: 2.1 time: 0.284553 Jul 19 15:47:59.104561 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 182/423] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:58 2022] GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40 => generated 1371 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:47:59.471717 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-a2484143-71ca-4656-94f5-8714f51fa9cf tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:59.472948 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-a2484143-71ca-4656-94f5-8714f51fa9cf tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: 78bc17d6-5509-446d-a843-99a70b397128] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:59.484119 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-a2484143-71ca-4656-94f5-8714f51fa9cf tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:59.485810 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-a2484143-71ca-4656-94f5-8714f51fa9cf tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:59.487120 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-a2484143-71ca-4656-94f5-8714f51fa9cf tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:59.488092 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-a2484143-71ca-4656-94f5-8714f51fa9cf tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:59.527206 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-f9f1cc50-8af2-4286-a469-4d8e0f75557c tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:59.543214 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-f9f1cc50-8af2-4286-a469-4d8e0f75557c tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:59.559285 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-f9f1cc50-8af2-4286-a469-4d8e0f75557c tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:59.560262 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-f9f1cc50-8af2-4286-a469-4d8e0f75557c tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:59.561479 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-f9f1cc50-8af2-4286-a469-4d8e0f75557c tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:59.571437 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-f9f1cc50-8af2-4286-a469-4d8e0f75557c tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:59.914286 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-a2484143-71ca-4656-94f5-8714f51fa9cf tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7c42cf0bc84292bb0b7edb9f2e7fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a72d232f314a78b0e1c3f04b0ed682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:47:59.918073 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG dbcounter [-] [129520] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=129520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:47:59.923164 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-a2484143-71ca-4656-94f5-8714f51fa9cf tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/78bc17d6-5509-446d-a843-99a70b397128" status: 200 len: 1367 microversion: 2.1 time: 0.459680 Jul 19 15:47:59.927140 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 242/424] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:59 2022] GET /compute/v2.1/servers/78bc17d6-5509-446d-a843-99a70b397128 => generated 1367 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:47:59.934528 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-e19023fb-3ebe-4b3f-a7d6-8e87ab4cab6d tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:47:59.935472 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-e19023fb-3ebe-4b3f-a7d6-8e87ab4cab6d tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] [instance: 17f9fd89-e668-4d3d-8d85-e648189ba0c2] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:47:59.951219 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-e19023fb-3ebe-4b3f-a7d6-8e87ab4cab6d tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:59.952018 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-e19023fb-3ebe-4b3f-a7d6-8e87ab4cab6d tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:59.962384 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-e19023fb-3ebe-4b3f-a7d6-8e87ab4cab6d tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:47:59.962852 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-e19023fb-3ebe-4b3f-a7d6-8e87ab4cab6d tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:47:59.995091 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-f9f1cc50-8af2-4286-a469-4d8e0f75557c tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:00.018858 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-f9f1cc50-8af2-4286-a469-4d8e0f75557c tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:00.023276 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-f9f1cc50-8af2-4286-a469-4d8e0f75557c tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:00.024836 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-f9f1cc50-8af2-4286-a469-4d8e0f75557c tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 200 len: 1808 microversion: 2.20 time: 0.507190 Jul 19 15:48:00.027248 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 183/425] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:47:59 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 1808 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:48:00.111991 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-312f4798-5629-4384-89ac-f435a0a0a235 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:00.112754 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-312f4798-5629-4384-89ac-f435a0a0a235 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 0194ecf2-5e08-49b2-a4e9-185bf9b32e40] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:00.119849 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-312f4798-5629-4384-89ac-f435a0a0a235 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:00.120426 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-312f4798-5629-4384-89ac-f435a0a0a235 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:00.121311 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-312f4798-5629-4384-89ac-f435a0a0a235 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:00.121925 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-312f4798-5629-4384-89ac-f435a0a0a235 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:00.150630 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-e19023fb-3ebe-4b3f-a7d6-8e87ab4cab6d tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae334c4d93cd4d3e94789a5985fcfa77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6827afcdf1f3481882f808dc01908a4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:00.159685 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-e19023fb-3ebe-4b3f-a7d6-8e87ab4cab6d tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] 10.222.0.64 "GET /compute/v2.1/servers/17f9fd89-e668-4d3d-8d85-e648189ba0c2" status: 200 len: 1265 microversion: 2.1 time: 0.229216 Jul 19 15:48:00.162726 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 243/426] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:47:59 2022] GET /compute/v2.1/servers/17f9fd89-e668-4d3d-8d85-e648189ba0c2 => generated 1265 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:48:00.668450 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-312f4798-5629-4384-89ac-f435a0a0a235 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:00.677512 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-312f4798-5629-4384-89ac-f435a0a0a235 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40" status: 200 len: 1371 microversion: 2.1 time: 0.569755 Jul 19 15:48:00.678106 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 184/427] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:48:00 2022] GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40 => generated 1371 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:48:00.945138 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-32e416bd-9a0c-41a5-b0a2-711bb277c6a5 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:00.945753 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-32e416bd-9a0c-41a5-b0a2-711bb277c6a5 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: 78bc17d6-5509-446d-a843-99a70b397128] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:00.952364 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-32e416bd-9a0c-41a5-b0a2-711bb277c6a5 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:00.953052 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-32e416bd-9a0c-41a5-b0a2-711bb277c6a5 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:00.954714 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-32e416bd-9a0c-41a5-b0a2-711bb277c6a5 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:00.959263 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-32e416bd-9a0c-41a5-b0a2-711bb277c6a5 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:01.045231 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-dd3a7bd1-cd22-4dd6-82a5-d120171a7963 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:01.045729 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-dd3a7bd1-cd22-4dd6-82a5-d120171a7963 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:01.062039 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-dd3a7bd1-cd22-4dd6-82a5-d120171a7963 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:01.062822 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-dd3a7bd1-cd22-4dd6-82a5-d120171a7963 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:01.064403 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-dd3a7bd1-cd22-4dd6-82a5-d120171a7963 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:01.065004 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-dd3a7bd1-cd22-4dd6-82a5-d120171a7963 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:01.214319 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-32e416bd-9a0c-41a5-b0a2-711bb277c6a5 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7c42cf0bc84292bb0b7edb9f2e7fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a72d232f314a78b0e1c3f04b0ed682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:01.228803 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-32e416bd-9a0c-41a5-b0a2-711bb277c6a5 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/78bc17d6-5509-446d-a843-99a70b397128" status: 200 len: 1367 microversion: 2.1 time: 0.287283 Jul 19 15:48:01.231412 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 244/428] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:48:00 2022] GET /compute/v2.1/servers/78bc17d6-5509-446d-a843-99a70b397128 => generated 1367 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:48:01.237547 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-7ffb2e39-1c75-4a1c-9527-cf9cfad5f3d2 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:01.239779 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-7ffb2e39-1c75-4a1c-9527-cf9cfad5f3d2 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] [instance: 17f9fd89-e668-4d3d-8d85-e648189ba0c2] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:01.252950 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-7ffb2e39-1c75-4a1c-9527-cf9cfad5f3d2 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:01.254521 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-7ffb2e39-1c75-4a1c-9527-cf9cfad5f3d2 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:01.255489 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-7ffb2e39-1c75-4a1c-9527-cf9cfad5f3d2 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:01.256347 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-7ffb2e39-1c75-4a1c-9527-cf9cfad5f3d2 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:01.399031 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-dd3a7bd1-cd22-4dd6-82a5-d120171a7963 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:01.413199 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-dd3a7bd1-cd22-4dd6-82a5-d120171a7963 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:01.415539 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-dd3a7bd1-cd22-4dd6-82a5-d120171a7963 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:01.418013 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-dd3a7bd1-cd22-4dd6-82a5-d120171a7963 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 200 len: 1808 microversion: 2.20 time: 0.376511 Jul 19 15:48:01.419230 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 185/429] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:48:01 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 1808 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 15:48:01.424672 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [req-8485293b-dcbf-4a3a-8326-751c0a1059fd req-74d663c5-b6ae-411a-97d6-21258f5f5f52 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78bc17d6-5509-446d-a843-99a70b397128", "name": "network-vif-plugged", "status": "completed", "tag": "41689fce-682e-44b2-a26f-83d31eb3790b"}]} {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:48:01.435546 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [req-8485293b-dcbf-4a3a-8326-751c0a1059fd req-74d663c5-b6ae-411a-97d6-21258f5f5f52 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:01.436373 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [req-8485293b-dcbf-4a3a-8326-751c0a1059fd req-74d663c5-b6ae-411a-97d6-21258f5f5f52 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:01.456839 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.compute.server_external_events [req-8485293b-dcbf-4a3a-8326-751c0a1059fd req-74d663c5-b6ae-411a-97d6-21258f5f5f52 service nova] Creating event network-vif-plugged:41689fce-682e-44b2-a26f-83d31eb3790b for instance 78bc17d6-5509-446d-a843-99a70b397128 on hv-cinder-84902 Jul 19 15:48:01.465807 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [req-8485293b-dcbf-4a3a-8326-751c0a1059fd req-74d663c5-b6ae-411a-97d6-21258f5f5f52 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044782 Jul 19 15:48:01.474642 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 186/430] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Jul 19 15:48:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:48:01.525198 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-7ffb2e39-1c75-4a1c-9527-cf9cfad5f3d2 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae334c4d93cd4d3e94789a5985fcfa77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6827afcdf1f3481882f808dc01908a4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:01.553198 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-7ffb2e39-1c75-4a1c-9527-cf9cfad5f3d2 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] 10.222.0.64 "GET /compute/v2.1/servers/17f9fd89-e668-4d3d-8d85-e648189ba0c2" status: 200 len: 1265 microversion: 2.1 time: 0.320301 Jul 19 15:48:01.553819 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 245/431] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:48:01 2022] GET /compute/v2.1/servers/17f9fd89-e668-4d3d-8d85-e648189ba0c2 => generated 1265 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:48:01.695536 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-dbdc5ab7-b48b-4043-ac6f-0170e4e56ca8 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:01.696423 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-dbdc5ab7-b48b-4043-ac6f-0170e4e56ca8 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 0194ecf2-5e08-49b2-a4e9-185bf9b32e40] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:01.708022 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG dbcounter [-] [129519] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=96 {{(pid=129519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:48:01.712274 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-dbdc5ab7-b48b-4043-ac6f-0170e4e56ca8 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:01.712809 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-dbdc5ab7-b48b-4043-ac6f-0170e4e56ca8 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:01.713961 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-dbdc5ab7-b48b-4043-ac6f-0170e4e56ca8 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:01.715815 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-dbdc5ab7-b48b-4043-ac6f-0170e4e56ca8 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:01.977735 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG dbcounter [-] [129520] Writing DB stats nova_cell0:SELECT=4 {{(pid=129520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:48:01.982900 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [req-ba79982e-d31d-4c99-bd66-5e0c59a06bdf req-d64fc2fd-9500-4ff7-9f8c-732c7524fe56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17f9fd89-e668-4d3d-8d85-e648189ba0c2", "tag": "e3f80a5b-6ebe-4e28-8cb3-bd8fbe84b1e6"}]} {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:48:01.994241 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [req-ba79982e-d31d-4c99-bd66-5e0c59a06bdf req-d64fc2fd-9500-4ff7-9f8c-732c7524fe56 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:01.994875 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [req-ba79982e-d31d-4c99-bd66-5e0c59a06bdf req-d64fc2fd-9500-4ff7-9f8c-732c7524fe56 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:02.014625 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.compute.server_external_events [req-ba79982e-d31d-4c99-bd66-5e0c59a06bdf req-d64fc2fd-9500-4ff7-9f8c-732c7524fe56 service nova] Creating event network-changed:e3f80a5b-6ebe-4e28-8cb3-bd8fbe84b1e6 for instance 17f9fd89-e668-4d3d-8d85-e648189ba0c2 on hv-cinder-84902 Jul 19 15:48:02.021393 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [req-ba79982e-d31d-4c99-bd66-5e0c59a06bdf req-d64fc2fd-9500-4ff7-9f8c-732c7524fe56 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044266 Jul 19 15:48:02.022766 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 246/432] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Jul 19 15:48:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:48:02.082470 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-dbdc5ab7-b48b-4043-ac6f-0170e4e56ca8 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:02.086066 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG dbcounter [-] [129519] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:48:02.095082 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-dbdc5ab7-b48b-4043-ac6f-0170e4e56ca8 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40" status: 200 len: 1371 microversion: 2.1 time: 0.400441 Jul 19 15:48:02.095082 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 187/433] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:48:01 2022] GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40 => generated 1371 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:48:02.252063 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-ed5730da-a7d8-42a7-9864-01608b63a53e tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:02.252670 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-ed5730da-a7d8-42a7-9864-01608b63a53e tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: 78bc17d6-5509-446d-a843-99a70b397128] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:02.254632 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG dbcounter [-] [129520] Writing DB stats nova_cell0:SELECT=20 {{(pid=129520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:48:02.261312 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-ed5730da-a7d8-42a7-9864-01608b63a53e tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:02.261756 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-ed5730da-a7d8-42a7-9864-01608b63a53e tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:02.262565 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-ed5730da-a7d8-42a7-9864-01608b63a53e tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:02.263007 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-ed5730da-a7d8-42a7-9864-01608b63a53e tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:02.435416 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-ed5730da-a7d8-42a7-9864-01608b63a53e tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7c42cf0bc84292bb0b7edb9f2e7fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a72d232f314a78b0e1c3f04b0ed682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:02.447191 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-11bafe13-c51f-47e3-a429-d24702926ee9 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:02.448193 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-11bafe13-c51f-47e3-a429-d24702926ee9 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:02.451184 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-ed5730da-a7d8-42a7-9864-01608b63a53e tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/78bc17d6-5509-446d-a843-99a70b397128" status: 200 len: 1367 microversion: 2.1 time: 0.203820 Jul 19 15:48:02.451904 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 247/434] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:48:02 2022] GET /compute/v2.1/servers/78bc17d6-5509-446d-a843-99a70b397128 => generated 1367 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:48:02.458214 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-11bafe13-c51f-47e3-a429-d24702926ee9 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:02.459537 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-11bafe13-c51f-47e3-a429-d24702926ee9 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:02.463815 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-11bafe13-c51f-47e3-a429-d24702926ee9 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:02.464283 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-11bafe13-c51f-47e3-a429-d24702926ee9 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:02.578086 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-054f41ea-0db0-480f-815a-afd1d16338f0 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:02.579530 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-054f41ea-0db0-480f-815a-afd1d16338f0 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] [instance: 17f9fd89-e668-4d3d-8d85-e648189ba0c2] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:02.586414 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-054f41ea-0db0-480f-815a-afd1d16338f0 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:02.587468 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-054f41ea-0db0-480f-815a-afd1d16338f0 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:02.588505 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-054f41ea-0db0-480f-815a-afd1d16338f0 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:02.589174 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-054f41ea-0db0-480f-815a-afd1d16338f0 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:02.648736 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-11bafe13-c51f-47e3-a429-d24702926ee9 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:02.658497 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-11bafe13-c51f-47e3-a429-d24702926ee9 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:02.660019 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-11bafe13-c51f-47e3-a429-d24702926ee9 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:02.661185 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-11bafe13-c51f-47e3-a429-d24702926ee9 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 200 len: 1808 microversion: 2.20 time: 0.218972 Jul 19 15:48:02.667165 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 188/435] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:48:02 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 1808 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 15:48:02.758343 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-054f41ea-0db0-480f-815a-afd1d16338f0 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae334c4d93cd4d3e94789a5985fcfa77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6827afcdf1f3481882f808dc01908a4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:02.766511 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-054f41ea-0db0-480f-815a-afd1d16338f0 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] 10.222.0.64 "GET /compute/v2.1/servers/17f9fd89-e668-4d3d-8d85-e648189ba0c2" status: 200 len: 1265 microversion: 2.1 time: 0.191810 Jul 19 15:48:02.767231 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 248/436] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:48:02 2022] GET /compute/v2.1/servers/17f9fd89-e668-4d3d-8d85-e648189ba0c2 => generated 1265 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:48:03.109038 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-3f6791d5-a121-46a0-8ba1-becfb59f5dab tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:03.109654 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-3f6791d5-a121-46a0-8ba1-becfb59f5dab tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 0194ecf2-5e08-49b2-a4e9-185bf9b32e40] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:03.116478 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-3f6791d5-a121-46a0-8ba1-becfb59f5dab tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:03.116952 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-3f6791d5-a121-46a0-8ba1-becfb59f5dab tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:03.117752 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-3f6791d5-a121-46a0-8ba1-becfb59f5dab tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:03.118334 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-3f6791d5-a121-46a0-8ba1-becfb59f5dab tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:03.257275 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-3f6791d5-a121-46a0-8ba1-becfb59f5dab tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:03.268370 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-3f6791d5-a121-46a0-8ba1-becfb59f5dab tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40" status: 200 len: 1371 microversion: 2.1 time: 0.162994 Jul 19 15:48:03.278574 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 189/437] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:48:03 2022] GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40 => generated 1371 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:48:03.469303 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-92e36fb1-46f3-42b3-a44a-3a59d3918c69 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:03.471540 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-92e36fb1-46f3-42b3-a44a-3a59d3918c69 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: 78bc17d6-5509-446d-a843-99a70b397128] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:03.479619 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-92e36fb1-46f3-42b3-a44a-3a59d3918c69 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:03.480539 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-92e36fb1-46f3-42b3-a44a-3a59d3918c69 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:03.481555 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-92e36fb1-46f3-42b3-a44a-3a59d3918c69 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:03.482096 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-92e36fb1-46f3-42b3-a44a-3a59d3918c69 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:03.484894 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [req-cd7fac49-8519-4abe-a709-743a57cfd985 req-f7da5b2b-9e65-4338-9f04-91e1b0cbd709 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0194ecf2-5e08-49b2-a4e9-185bf9b32e40", "name": "network-vif-plugged", "status": "completed", "tag": "588a9a7a-f29d-40a2-abf8-161404100f96"}]} {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:48:03.493829 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [req-cd7fac49-8519-4abe-a709-743a57cfd985 req-f7da5b2b-9e65-4338-9f04-91e1b0cbd709 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:03.494265 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [req-cd7fac49-8519-4abe-a709-743a57cfd985 req-f7da5b2b-9e65-4338-9f04-91e1b0cbd709 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:03.505565 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.compute.server_external_events [req-cd7fac49-8519-4abe-a709-743a57cfd985 req-f7da5b2b-9e65-4338-9f04-91e1b0cbd709 service nova] Creating event network-vif-plugged:588a9a7a-f29d-40a2-abf8-161404100f96 for instance 0194ecf2-5e08-49b2-a4e9-185bf9b32e40 on hv-cinder-84902 Jul 19 15:48:03.510550 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [req-cd7fac49-8519-4abe-a709-743a57cfd985 req-f7da5b2b-9e65-4338-9f04-91e1b0cbd709 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029282 Jul 19 15:48:03.511135 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 190/438] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Jul 19 15:48:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 15:48:03.646810 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-92e36fb1-46f3-42b3-a44a-3a59d3918c69 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7c42cf0bc84292bb0b7edb9f2e7fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a72d232f314a78b0e1c3f04b0ed682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:03.655297 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-92e36fb1-46f3-42b3-a44a-3a59d3918c69 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/78bc17d6-5509-446d-a843-99a70b397128" status: 200 len: 1367 microversion: 2.1 time: 0.190104 Jul 19 15:48:03.655974 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 249/439] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:48:03 2022] GET /compute/v2.1/servers/78bc17d6-5509-446d-a843-99a70b397128 => generated 1367 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:48:03.689459 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-3425b1ab-86a7-4766-b243-2be16908d00f tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:03.690150 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-3425b1ab-86a7-4766-b243-2be16908d00f tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:03.697122 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-3425b1ab-86a7-4766-b243-2be16908d00f tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:03.697573 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-3425b1ab-86a7-4766-b243-2be16908d00f tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:03.698449 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-3425b1ab-86a7-4766-b243-2be16908d00f tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:03.698836 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-3425b1ab-86a7-4766-b243-2be16908d00f tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:03.784286 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-d2ee9d54-3eaa-4874-bdb9-bc42b9344968 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:03.784811 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-d2ee9d54-3eaa-4874-bdb9-bc42b9344968 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] [instance: 17f9fd89-e668-4d3d-8d85-e648189ba0c2] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:03.792011 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-d2ee9d54-3eaa-4874-bdb9-bc42b9344968 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:03.793921 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-d2ee9d54-3eaa-4874-bdb9-bc42b9344968 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:03.795351 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-d2ee9d54-3eaa-4874-bdb9-bc42b9344968 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:03.796394 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-d2ee9d54-3eaa-4874-bdb9-bc42b9344968 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:03.871320 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-3425b1ab-86a7-4766-b243-2be16908d00f tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:03.882695 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-3425b1ab-86a7-4766-b243-2be16908d00f tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:03.884178 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-3425b1ab-86a7-4766-b243-2be16908d00f tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:03.885339 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-3425b1ab-86a7-4766-b243-2be16908d00f tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 200 len: 1808 microversion: 2.20 time: 0.200979 Jul 19 15:48:03.896572 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 191/440] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:48:03 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 1808 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:48:03.971164 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-d2ee9d54-3eaa-4874-bdb9-bc42b9344968 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae334c4d93cd4d3e94789a5985fcfa77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6827afcdf1f3481882f808dc01908a4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:03.979538 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-d2ee9d54-3eaa-4874-bdb9-bc42b9344968 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] 10.222.0.64 "GET /compute/v2.1/servers/17f9fd89-e668-4d3d-8d85-e648189ba0c2" status: 200 len: 1265 microversion: 2.1 time: 0.199636 Jul 19 15:48:03.980138 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 250/441] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:48:03 2022] GET /compute/v2.1/servers/17f9fd89-e668-4d3d-8d85-e648189ba0c2 => generated 1265 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:48:04.285506 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-8c720d20-ccad-419e-bc9d-3fa8704191d3 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:04.287033 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-8c720d20-ccad-419e-bc9d-3fa8704191d3 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 0194ecf2-5e08-49b2-a4e9-185bf9b32e40] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:04.293667 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-8c720d20-ccad-419e-bc9d-3fa8704191d3 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:04.294234 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-8c720d20-ccad-419e-bc9d-3fa8704191d3 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:04.295141 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-8c720d20-ccad-419e-bc9d-3fa8704191d3 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:04.295693 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-8c720d20-ccad-419e-bc9d-3fa8704191d3 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:04.457348 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-8c720d20-ccad-419e-bc9d-3fa8704191d3 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:04.470042 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-8c720d20-ccad-419e-bc9d-3fa8704191d3 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40" status: 200 len: 1371 microversion: 2.1 time: 0.188491 Jul 19 15:48:04.479400 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 192/442] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:48:04 2022] GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40 => generated 1371 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:48:04.674080 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-1d72c3bb-3b29-4dce-a32a-24334241c610 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:04.674732 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-1d72c3bb-3b29-4dce-a32a-24334241c610 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: 78bc17d6-5509-446d-a843-99a70b397128] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:04.681642 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-1d72c3bb-3b29-4dce-a32a-24334241c610 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:04.682092 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-1d72c3bb-3b29-4dce-a32a-24334241c610 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:04.682899 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-1d72c3bb-3b29-4dce-a32a-24334241c610 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:04.683337 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-1d72c3bb-3b29-4dce-a32a-24334241c610 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:04.858573 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-1d72c3bb-3b29-4dce-a32a-24334241c610 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7c42cf0bc84292bb0b7edb9f2e7fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a72d232f314a78b0e1c3f04b0ed682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:04.867347 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-1d72c3bb-3b29-4dce-a32a-24334241c610 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/78bc17d6-5509-446d-a843-99a70b397128" status: 200 len: 1367 microversion: 2.1 time: 0.197897 Jul 19 15:48:04.867936 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 251/443] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:48:04 2022] GET /compute/v2.1/servers/78bc17d6-5509-446d-a843-99a70b397128 => generated 1367 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:48:04.904068 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-43a14a0b-2e62-405f-89e5-ef0c77ab8766 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:04.904780 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-43a14a0b-2e62-405f-89e5-ef0c77ab8766 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:04.912913 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-43a14a0b-2e62-405f-89e5-ef0c77ab8766 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:04.913471 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-43a14a0b-2e62-405f-89e5-ef0c77ab8766 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:04.914321 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-43a14a0b-2e62-405f-89e5-ef0c77ab8766 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:04.914856 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-43a14a0b-2e62-405f-89e5-ef0c77ab8766 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:05.005527 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-78e0aafd-8591-418a-b42b-9dbae78c1119 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:05.006225 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-78e0aafd-8591-418a-b42b-9dbae78c1119 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] [instance: 17f9fd89-e668-4d3d-8d85-e648189ba0c2] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:05.013185 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-78e0aafd-8591-418a-b42b-9dbae78c1119 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:05.013717 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-78e0aafd-8591-418a-b42b-9dbae78c1119 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:05.014647 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-78e0aafd-8591-418a-b42b-9dbae78c1119 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:05.015151 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-78e0aafd-8591-418a-b42b-9dbae78c1119 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:05.074193 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-43a14a0b-2e62-405f-89e5-ef0c77ab8766 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:05.084598 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-43a14a0b-2e62-405f-89e5-ef0c77ab8766 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:05.086094 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-43a14a0b-2e62-405f-89e5-ef0c77ab8766 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:05.087309 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-43a14a0b-2e62-405f-89e5-ef0c77ab8766 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 200 len: 1808 microversion: 2.20 time: 0.187192 Jul 19 15:48:05.087893 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 193/444] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:48:04 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 1808 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:48:05.177232 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-78e0aafd-8591-418a-b42b-9dbae78c1119 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae334c4d93cd4d3e94789a5985fcfa77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6827afcdf1f3481882f808dc01908a4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:05.185614 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-78e0aafd-8591-418a-b42b-9dbae78c1119 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] 10.222.0.64 "GET /compute/v2.1/servers/17f9fd89-e668-4d3d-8d85-e648189ba0c2" status: 200 len: 1265 microversion: 2.1 time: 0.192091 Jul 19 15:48:05.186188 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 252/445] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:48:04 2022] GET /compute/v2.1/servers/17f9fd89-e668-4d3d-8d85-e648189ba0c2 => generated 1265 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:48:05.494748 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-326cb33f-27b5-4bf4-882a-2b5ec65e3ac4 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:05.495445 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-326cb33f-27b5-4bf4-882a-2b5ec65e3ac4 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 0194ecf2-5e08-49b2-a4e9-185bf9b32e40] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:05.501820 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-326cb33f-27b5-4bf4-882a-2b5ec65e3ac4 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:05.502271 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-326cb33f-27b5-4bf4-882a-2b5ec65e3ac4 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:05.503077 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-326cb33f-27b5-4bf4-882a-2b5ec65e3ac4 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:05.503654 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-326cb33f-27b5-4bf4-882a-2b5ec65e3ac4 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:05.647758 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-326cb33f-27b5-4bf4-882a-2b5ec65e3ac4 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:05.658467 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-326cb33f-27b5-4bf4-882a-2b5ec65e3ac4 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40" status: 200 len: 1371 microversion: 2.1 time: 0.169156 Jul 19 15:48:05.659249 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 194/446] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:48:05 2022] GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40 => generated 1371 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:48:05.884626 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-e60a23a3-0155-44c9-a25e-8f4c03027249 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:05.885198 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-e60a23a3-0155-44c9-a25e-8f4c03027249 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: 78bc17d6-5509-446d-a843-99a70b397128] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:05.891771 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-e60a23a3-0155-44c9-a25e-8f4c03027249 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:05.892365 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-e60a23a3-0155-44c9-a25e-8f4c03027249 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:05.893116 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-e60a23a3-0155-44c9-a25e-8f4c03027249 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:05.893543 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-e60a23a3-0155-44c9-a25e-8f4c03027249 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:06.043938 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-e60a23a3-0155-44c9-a25e-8f4c03027249 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7c42cf0bc84292bb0b7edb9f2e7fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a72d232f314a78b0e1c3f04b0ed682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:06.053241 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-e60a23a3-0155-44c9-a25e-8f4c03027249 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/78bc17d6-5509-446d-a843-99a70b397128" status: 200 len: 1367 microversion: 2.1 time: 0.172489 Jul 19 15:48:06.054000 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 253/447] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:48:05 2022] GET /compute/v2.1/servers/78bc17d6-5509-446d-a843-99a70b397128 => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:48:06.114086 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-f2abd4ac-09d7-480a-9011-baa74695ca11 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:06.116847 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-f2abd4ac-09d7-480a-9011-baa74695ca11 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:06.123209 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-f2abd4ac-09d7-480a-9011-baa74695ca11 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:06.123501 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-f2abd4ac-09d7-480a-9011-baa74695ca11 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:06.124166 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-f2abd4ac-09d7-480a-9011-baa74695ca11 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:06.124604 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-f2abd4ac-09d7-480a-9011-baa74695ca11 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:06.206328 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-48f19200-bdc3-4b69-9537-68d9a300c71e tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:06.207693 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-48f19200-bdc3-4b69-9537-68d9a300c71e tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] [instance: 17f9fd89-e668-4d3d-8d85-e648189ba0c2] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:06.214057 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-48f19200-bdc3-4b69-9537-68d9a300c71e tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:06.214871 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-48f19200-bdc3-4b69-9537-68d9a300c71e tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:06.215998 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-48f19200-bdc3-4b69-9537-68d9a300c71e tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:06.216618 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-48f19200-bdc3-4b69-9537-68d9a300c71e tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:06.291974 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-f2abd4ac-09d7-480a-9011-baa74695ca11 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:06.301638 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-f2abd4ac-09d7-480a-9011-baa74695ca11 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:06.303381 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-f2abd4ac-09d7-480a-9011-baa74695ca11 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:06.304650 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-f2abd4ac-09d7-480a-9011-baa74695ca11 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 200 len: 1808 microversion: 2.20 time: 0.203074 Jul 19 15:48:06.317803 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 195/448] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:48:06 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 1808 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:48:06.401551 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-48f19200-bdc3-4b69-9537-68d9a300c71e tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae334c4d93cd4d3e94789a5985fcfa77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6827afcdf1f3481882f808dc01908a4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:06.412372 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-48f19200-bdc3-4b69-9537-68d9a300c71e tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] 10.222.0.64 "GET /compute/v2.1/servers/17f9fd89-e668-4d3d-8d85-e648189ba0c2" status: 200 len: 1265 microversion: 2.1 time: 0.211250 Jul 19 15:48:06.413038 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 254/449] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:48:06 2022] GET /compute/v2.1/servers/17f9fd89-e668-4d3d-8d85-e648189ba0c2 => generated 1265 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:48:06.680070 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-b71bec8c-e41c-46d1-9ead-a1ad875a298c tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:06.682058 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-b71bec8c-e41c-46d1-9ead-a1ad875a298c tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 0194ecf2-5e08-49b2-a4e9-185bf9b32e40] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:06.692800 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-b71bec8c-e41c-46d1-9ead-a1ad875a298c tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:06.693438 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-b71bec8c-e41c-46d1-9ead-a1ad875a298c tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:06.694319 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-b71bec8c-e41c-46d1-9ead-a1ad875a298c tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:06.695050 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-b71bec8c-e41c-46d1-9ead-a1ad875a298c tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:06.872362 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-b71bec8c-e41c-46d1-9ead-a1ad875a298c tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:06.883711 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-b71bec8c-e41c-46d1-9ead-a1ad875a298c tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40" status: 200 len: 1371 microversion: 2.1 time: 0.211048 Jul 19 15:48:06.884624 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 196/450] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:48:06 2022] GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40 => generated 1371 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:48:07.071496 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-4b73c1c7-57ef-4588-b509-3e544821ed97 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:07.072232 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-4b73c1c7-57ef-4588-b509-3e544821ed97 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: 78bc17d6-5509-446d-a843-99a70b397128] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:07.079223 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-4b73c1c7-57ef-4588-b509-3e544821ed97 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:07.079666 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-4b73c1c7-57ef-4588-b509-3e544821ed97 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:07.080459 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-4b73c1c7-57ef-4588-b509-3e544821ed97 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:07.080890 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-4b73c1c7-57ef-4588-b509-3e544821ed97 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:07.224809 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-4b73c1c7-57ef-4588-b509-3e544821ed97 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7c42cf0bc84292bb0b7edb9f2e7fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a72d232f314a78b0e1c3f04b0ed682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:07.232820 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-4b73c1c7-57ef-4588-b509-3e544821ed97 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/78bc17d6-5509-446d-a843-99a70b397128" status: 200 len: 1367 microversion: 2.1 time: 0.165787 Jul 19 15:48:07.238775 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 255/451] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:48:07 2022] GET /compute/v2.1/servers/78bc17d6-5509-446d-a843-99a70b397128 => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:48:07.324537 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-082f8f92-eb37-480e-a37c-c39ec12f6eb0 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:07.325173 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-082f8f92-eb37-480e-a37c-c39ec12f6eb0 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:07.332989 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-082f8f92-eb37-480e-a37c-c39ec12f6eb0 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:07.333447 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-082f8f92-eb37-480e-a37c-c39ec12f6eb0 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:07.334254 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-082f8f92-eb37-480e-a37c-c39ec12f6eb0 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:07.334699 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-082f8f92-eb37-480e-a37c-c39ec12f6eb0 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:07.430581 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-14c173e7-274f-4912-b8c9-5377f3418a68 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:07.431239 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-14c173e7-274f-4912-b8c9-5377f3418a68 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] [instance: 17f9fd89-e668-4d3d-8d85-e648189ba0c2] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:07.437641 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-14c173e7-274f-4912-b8c9-5377f3418a68 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:07.438676 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-14c173e7-274f-4912-b8c9-5377f3418a68 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:07.439479 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-14c173e7-274f-4912-b8c9-5377f3418a68 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:07.439927 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-14c173e7-274f-4912-b8c9-5377f3418a68 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:07.477130 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-082f8f92-eb37-480e-a37c-c39ec12f6eb0 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:07.487489 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-082f8f92-eb37-480e-a37c-c39ec12f6eb0 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:07.489222 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-082f8f92-eb37-480e-a37c-c39ec12f6eb0 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:07.490874 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-082f8f92-eb37-480e-a37c-c39ec12f6eb0 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 200 len: 1808 microversion: 2.20 time: 0.170399 Jul 19 15:48:07.491960 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 197/452] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:48:07 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:48:07.589891 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-14c173e7-274f-4912-b8c9-5377f3418a68 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae334c4d93cd4d3e94789a5985fcfa77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6827afcdf1f3481882f808dc01908a4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:07.599134 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-14c173e7-274f-4912-b8c9-5377f3418a68 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] 10.222.0.64 "GET /compute/v2.1/servers/17f9fd89-e668-4d3d-8d85-e648189ba0c2" status: 200 len: 1265 microversion: 2.1 time: 0.172096 Jul 19 15:48:07.609020 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 256/453] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:48:07 2022] GET /compute/v2.1/servers/17f9fd89-e668-4d3d-8d85-e648189ba0c2 => generated 1265 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:48:07.901400 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-5606448f-172a-4667-be40-c588bd144e24 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:07.902888 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-5606448f-172a-4667-be40-c588bd144e24 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 0194ecf2-5e08-49b2-a4e9-185bf9b32e40] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:07.911407 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-5606448f-172a-4667-be40-c588bd144e24 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:07.912190 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-5606448f-172a-4667-be40-c588bd144e24 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:07.913207 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-5606448f-172a-4667-be40-c588bd144e24 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:07.914045 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-5606448f-172a-4667-be40-c588bd144e24 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:08.053288 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-5606448f-172a-4667-be40-c588bd144e24 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:08.060872 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-5606448f-172a-4667-be40-c588bd144e24 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40" status: 200 len: 1371 microversion: 2.1 time: 0.163749 Jul 19 15:48:08.061449 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 198/454] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:48:07 2022] GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40 => generated 1371 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:48:08.250480 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-6b997c35-0929-457c-9705-33c87cc06370 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:08.252796 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-6b997c35-0929-457c-9705-33c87cc06370 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: 78bc17d6-5509-446d-a843-99a70b397128] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:08.259681 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-6b997c35-0929-457c-9705-33c87cc06370 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:08.260123 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-6b997c35-0929-457c-9705-33c87cc06370 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:08.260894 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-6b997c35-0929-457c-9705-33c87cc06370 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:08.261326 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-6b997c35-0929-457c-9705-33c87cc06370 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:08.398949 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-6b997c35-0929-457c-9705-33c87cc06370 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7c42cf0bc84292bb0b7edb9f2e7fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a72d232f314a78b0e1c3f04b0ed682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:08.406706 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-6b997c35-0929-457c-9705-33c87cc06370 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/78bc17d6-5509-446d-a843-99a70b397128" status: 200 len: 1367 microversion: 2.1 time: 0.160084 Jul 19 15:48:08.407838 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 257/455] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:48:08 2022] GET /compute/v2.1/servers/78bc17d6-5509-446d-a843-99a70b397128 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:48:08.514519 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-f70e9795-2b5d-4800-bfec-b8e0f391394a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:08.515135 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-f70e9795-2b5d-4800-bfec-b8e0f391394a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:08.522254 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-f70e9795-2b5d-4800-bfec-b8e0f391394a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:08.522751 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-f70e9795-2b5d-4800-bfec-b8e0f391394a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:08.523527 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-f70e9795-2b5d-4800-bfec-b8e0f391394a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:08.523966 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-f70e9795-2b5d-4800-bfec-b8e0f391394a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:08.616961 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-67cac28f-0eae-47c0-bf43-1850802e572d tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:08.617563 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-67cac28f-0eae-47c0-bf43-1850802e572d tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] [instance: 17f9fd89-e668-4d3d-8d85-e648189ba0c2] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:08.624253 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-67cac28f-0eae-47c0-bf43-1850802e572d tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:08.624697 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-67cac28f-0eae-47c0-bf43-1850802e572d tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:08.625463 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-67cac28f-0eae-47c0-bf43-1850802e572d tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:08.626638 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-67cac28f-0eae-47c0-bf43-1850802e572d tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:08.663110 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-f70e9795-2b5d-4800-bfec-b8e0f391394a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:08.671792 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-f70e9795-2b5d-4800-bfec-b8e0f391394a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:08.673831 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-f70e9795-2b5d-4800-bfec-b8e0f391394a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:08.675048 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-f70e9795-2b5d-4800-bfec-b8e0f391394a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 200 len: 1808 microversion: 2.20 time: 0.164482 Jul 19 15:48:08.676019 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 199/456] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:48:08 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:48:08.794752 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-67cac28f-0eae-47c0-bf43-1850802e572d tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae334c4d93cd4d3e94789a5985fcfa77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6827afcdf1f3481882f808dc01908a4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:08.802293 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-239ef08a-825b-4217-a56b-23eb74293952 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:08.803070 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-239ef08a-825b-4217-a56b-23eb74293952 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 343ae383-5bfd-4c70-8926-a800fcee3519] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:08.810411 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-239ef08a-825b-4217-a56b-23eb74293952 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:08.811029 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-239ef08a-825b-4217-a56b-23eb74293952 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:08.811293 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-67cac28f-0eae-47c0-bf43-1850802e572d tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] 10.222.0.64 "GET /compute/v2.1/servers/17f9fd89-e668-4d3d-8d85-e648189ba0c2" status: 200 len: 1265 microversion: 2.1 time: 0.190366 Jul 19 15:48:08.812088 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-239ef08a-825b-4217-a56b-23eb74293952 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:08.812595 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-239ef08a-825b-4217-a56b-23eb74293952 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:08.814352 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 258/457] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:48:08 2022] GET /compute/v2.1/servers/17f9fd89-e668-4d3d-8d85-e648189ba0c2 => generated 1265 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:48:08.847170 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-239ef08a-825b-4217-a56b-23eb74293952 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519/ips" status: 200 len: 146 microversion: 2.1 time: 0.050633 Jul 19 15:48:08.851426 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 200/458] 10.222.0.64 () {58 vars in 1247 bytes} [Tue Jul 19 15:48:08 2022] GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519/ips => generated 146 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 15:48:09.081942 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-b7edc611-b8ca-430d-83af-a0fabe8ac625 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:09.082598 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-b7edc611-b8ca-430d-83af-a0fabe8ac625 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 0194ecf2-5e08-49b2-a4e9-185bf9b32e40] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:09.088603 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b7edc611-b8ca-430d-83af-a0fabe8ac625 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:09.089033 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b7edc611-b8ca-430d-83af-a0fabe8ac625 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:09.089796 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b7edc611-b8ca-430d-83af-a0fabe8ac625 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:09.090232 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b7edc611-b8ca-430d-83af-a0fabe8ac625 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:09.231287 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-b7edc611-b8ca-430d-83af-a0fabe8ac625 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:09.239683 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-b7edc611-b8ca-430d-83af-a0fabe8ac625 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40" status: 200 len: 1371 microversion: 2.1 time: 0.163295 Jul 19 15:48:09.240258 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 259/459] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:48:09 2022] GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40 => generated 1371 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:48:09.425676 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-ac45972e-d9fa-4d67-95ff-0df97d7059a2 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:09.426290 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-ac45972e-d9fa-4d67-95ff-0df97d7059a2 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: 78bc17d6-5509-446d-a843-99a70b397128] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:09.432262 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-ac45972e-d9fa-4d67-95ff-0df97d7059a2 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:09.432702 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-ac45972e-d9fa-4d67-95ff-0df97d7059a2 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:09.433471 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-ac45972e-d9fa-4d67-95ff-0df97d7059a2 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:09.434207 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-ac45972e-d9fa-4d67-95ff-0df97d7059a2 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:09.577617 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-ac45972e-d9fa-4d67-95ff-0df97d7059a2 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7c42cf0bc84292bb0b7edb9f2e7fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a72d232f314a78b0e1c3f04b0ed682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:09.585643 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-ac45972e-d9fa-4d67-95ff-0df97d7059a2 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/78bc17d6-5509-446d-a843-99a70b397128" status: 200 len: 1367 microversion: 2.1 time: 0.165107 Jul 19 15:48:09.586201 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 201/460] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:48:09 2022] GET /compute/v2.1/servers/78bc17d6-5509-446d-a843-99a70b397128 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:48:09.693731 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-147c6ee7-e659-4419-aef8-8e236cb69be9 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:09.694483 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-147c6ee7-e659-4419-aef8-8e236cb69be9 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:09.697087 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG dbcounter [-] [129520] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=129520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:48:09.703417 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-147c6ee7-e659-4419-aef8-8e236cb69be9 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:09.704431 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-147c6ee7-e659-4419-aef8-8e236cb69be9 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:09.705356 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-147c6ee7-e659-4419-aef8-8e236cb69be9 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:09.705928 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-147c6ee7-e659-4419-aef8-8e236cb69be9 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:09.711132 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG dbcounter [-] [129520] Writing DB stats nova_cell1:SELECT=100 {{(pid=129520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:48:09.832558 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-632f9e14-3203-48ea-945e-56d57783559b tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:09.833331 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-632f9e14-3203-48ea-945e-56d57783559b tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] [instance: 17f9fd89-e668-4d3d-8d85-e648189ba0c2] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:09.843822 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-632f9e14-3203-48ea-945e-56d57783559b tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:09.844303 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-632f9e14-3203-48ea-945e-56d57783559b tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:09.845077 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-632f9e14-3203-48ea-945e-56d57783559b tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:09.845614 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-632f9e14-3203-48ea-945e-56d57783559b tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:09.865802 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-147c6ee7-e659-4419-aef8-8e236cb69be9 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:09.877995 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-147c6ee7-e659-4419-aef8-8e236cb69be9 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:09.881332 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-147c6ee7-e659-4419-aef8-8e236cb69be9 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:09.882702 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-147c6ee7-e659-4419-aef8-8e236cb69be9 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 200 len: 1808 microversion: 2.20 time: 0.192870 Jul 19 15:48:09.883388 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 260/461] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:48:09 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 1808 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:48:09.993772 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-632f9e14-3203-48ea-945e-56d57783559b tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae334c4d93cd4d3e94789a5985fcfa77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6827afcdf1f3481882f808dc01908a4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:10.001306 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-632f9e14-3203-48ea-945e-56d57783559b tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] 10.222.0.64 "GET /compute/v2.1/servers/17f9fd89-e668-4d3d-8d85-e648189ba0c2" status: 200 len: 1265 microversion: 2.1 time: 0.174328 Jul 19 15:48:10.001863 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 202/462] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:48:09 2022] GET /compute/v2.1/servers/17f9fd89-e668-4d3d-8d85-e648189ba0c2 => generated 1265 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:48:10.256912 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-01da3c56-b44e-4e7b-b8a1-5e82df365ce5 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:10.257576 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-01da3c56-b44e-4e7b-b8a1-5e82df365ce5 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 0194ecf2-5e08-49b2-a4e9-185bf9b32e40] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:10.274243 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-01da3c56-b44e-4e7b-b8a1-5e82df365ce5 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:10.274950 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-01da3c56-b44e-4e7b-b8a1-5e82df365ce5 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:10.275539 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-01da3c56-b44e-4e7b-b8a1-5e82df365ce5 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:10.276022 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-01da3c56-b44e-4e7b-b8a1-5e82df365ce5 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:10.443567 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-01da3c56-b44e-4e7b-b8a1-5e82df365ce5 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:10.453234 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-01da3c56-b44e-4e7b-b8a1-5e82df365ce5 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40" status: 200 len: 1371 microversion: 2.1 time: 0.199867 Jul 19 15:48:10.462442 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 261/463] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:48:10 2022] GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40 => generated 1371 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:48:10.603867 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-6b3180f2-1a07-4dae-b38c-05b82d8080d6 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:10.605186 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-6b3180f2-1a07-4dae-b38c-05b82d8080d6 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: 78bc17d6-5509-446d-a843-99a70b397128] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:10.612651 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-6b3180f2-1a07-4dae-b38c-05b82d8080d6 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:10.613103 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-6b3180f2-1a07-4dae-b38c-05b82d8080d6 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:10.613911 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-6b3180f2-1a07-4dae-b38c-05b82d8080d6 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:10.614453 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-6b3180f2-1a07-4dae-b38c-05b82d8080d6 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:10.766044 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-6b3180f2-1a07-4dae-b38c-05b82d8080d6 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7c42cf0bc84292bb0b7edb9f2e7fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a72d232f314a78b0e1c3f04b0ed682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:10.774885 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-6b3180f2-1a07-4dae-b38c-05b82d8080d6 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/78bc17d6-5509-446d-a843-99a70b397128" status: 200 len: 1367 microversion: 2.1 time: 0.175380 Jul 19 15:48:10.775457 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 203/464] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:48:10 2022] GET /compute/v2.1/servers/78bc17d6-5509-446d-a843-99a70b397128 => generated 1367 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:48:10.902414 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-7c45bf1e-f56d-4282-a69b-02900834be45 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:10.903005 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-7c45bf1e-f56d-4282-a69b-02900834be45 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:10.909559 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-7c45bf1e-f56d-4282-a69b-02900834be45 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:10.910008 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-7c45bf1e-f56d-4282-a69b-02900834be45 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:10.910795 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-7c45bf1e-f56d-4282-a69b-02900834be45 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:10.911232 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-7c45bf1e-f56d-4282-a69b-02900834be45 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:11.017959 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-0341e417-6ff6-46fb-9912-9be76e931a18 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:11.018945 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-0341e417-6ff6-46fb-9912-9be76e931a18 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] [instance: 17f9fd89-e668-4d3d-8d85-e648189ba0c2] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:11.034157 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-0341e417-6ff6-46fb-9912-9be76e931a18 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:11.034742 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-0341e417-6ff6-46fb-9912-9be76e931a18 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:11.035605 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-0341e417-6ff6-46fb-9912-9be76e931a18 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:11.036143 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-0341e417-6ff6-46fb-9912-9be76e931a18 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:11.053024 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-7c45bf1e-f56d-4282-a69b-02900834be45 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:11.062473 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-7c45bf1e-f56d-4282-a69b-02900834be45 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:11.064026 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-7c45bf1e-f56d-4282-a69b-02900834be45 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:11.065326 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-7c45bf1e-f56d-4282-a69b-02900834be45 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 200 len: 1808 microversion: 2.20 time: 0.166839 Jul 19 15:48:11.066218 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 262/465] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:48:10 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 1808 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:48:11.191370 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-0341e417-6ff6-46fb-9912-9be76e931a18 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae334c4d93cd4d3e94789a5985fcfa77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6827afcdf1f3481882f808dc01908a4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:11.199184 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-0341e417-6ff6-46fb-9912-9be76e931a18 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] 10.222.0.64 "GET /compute/v2.1/servers/17f9fd89-e668-4d3d-8d85-e648189ba0c2" status: 200 len: 1265 microversion: 2.1 time: 0.185772 Jul 19 15:48:11.199762 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 204/466] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:48:11 2022] GET /compute/v2.1/servers/17f9fd89-e668-4d3d-8d85-e648189ba0c2 => generated 1265 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:48:11.479292 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-1fd01db9-f342-45a8-a4d9-346ffd374a24 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:11.479924 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-1fd01db9-f342-45a8-a4d9-346ffd374a24 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 0194ecf2-5e08-49b2-a4e9-185bf9b32e40] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:11.486648 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-1fd01db9-f342-45a8-a4d9-346ffd374a24 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:11.487092 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-1fd01db9-f342-45a8-a4d9-346ffd374a24 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:11.487849 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-1fd01db9-f342-45a8-a4d9-346ffd374a24 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:11.488279 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-1fd01db9-f342-45a8-a4d9-346ffd374a24 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:11.633036 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-1fd01db9-f342-45a8-a4d9-346ffd374a24 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:11.648162 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-1fd01db9-f342-45a8-a4d9-346ffd374a24 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40" status: 200 len: 1371 microversion: 2.1 time: 0.166120 Jul 19 15:48:11.649148 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 263/467] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:48:11 2022] GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40 => generated 1371 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:48:11.668304 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-8422c5f0-28eb-4091-b918-33aa8051e5fa tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "68b2044b-bc1a-4502-8827-2b996b18515f"}} {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:48:11.670078 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-8422c5f0-28eb-4091-b918-33aa8051e5fa tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 343ae383-5bfd-4c70-8926-a800fcee3519] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:11.677398 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-8422c5f0-28eb-4091-b918-33aa8051e5fa tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:11.677846 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-8422c5f0-28eb-4091-b918-33aa8051e5fa tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:11.678656 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-8422c5f0-28eb-4091-b918-33aa8051e5fa tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:11.679097 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-8422c5f0-28eb-4091-b918-33aa8051e5fa tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:11.698387 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG dbcounter [-] [129519] Writing DB stats nova_cell1:SELECT=100 {{(pid=129519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:48:11.792259 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-1f4c97d2-f6c2-47a4-b6f2-f5801772d201 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:11.792860 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-1f4c97d2-f6c2-47a4-b6f2-f5801772d201 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: 78bc17d6-5509-446d-a843-99a70b397128] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:11.799278 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-1f4c97d2-f6c2-47a4-b6f2-f5801772d201 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:11.800605 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-1f4c97d2-f6c2-47a4-b6f2-f5801772d201 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:11.800605 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-1f4c97d2-f6c2-47a4-b6f2-f5801772d201 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:11.800886 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-1f4c97d2-f6c2-47a4-b6f2-f5801772d201 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:11.941645 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-1f4c97d2-f6c2-47a4-b6f2-f5801772d201 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7c42cf0bc84292bb0b7edb9f2e7fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a72d232f314a78b0e1c3f04b0ed682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:11.950727 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-1f4c97d2-f6c2-47a4-b6f2-f5801772d201 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/78bc17d6-5509-446d-a843-99a70b397128" status: 200 len: 1367 microversion: 2.1 time: 0.162403 Jul 19 15:48:11.960806 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 264/468] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:48:11 2022] GET /compute/v2.1/servers/78bc17d6-5509-446d-a843-99a70b397128 => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:48:12.084164 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-2031c8d2-0c76-4cab-9fd4-2ba8c8eb6a18 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:12.084876 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-2031c8d2-0c76-4cab-9fd4-2ba8c8eb6a18 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:12.091164 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-2031c8d2-0c76-4cab-9fd4-2ba8c8eb6a18 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:12.091602 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-2031c8d2-0c76-4cab-9fd4-2ba8c8eb6a18 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:12.092397 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-2031c8d2-0c76-4cab-9fd4-2ba8c8eb6a18 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:12.092851 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-2031c8d2-0c76-4cab-9fd4-2ba8c8eb6a18 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:12.233401 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-2031c8d2-0c76-4cab-9fd4-2ba8c8eb6a18 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:12.243239 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-2031c8d2-0c76-4cab-9fd4-2ba8c8eb6a18 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:12.244764 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-2031c8d2-0c76-4cab-9fd4-2ba8c8eb6a18 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:12.245938 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-2031c8d2-0c76-4cab-9fd4-2ba8c8eb6a18 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 200 len: 1808 microversion: 2.20 time: 0.165826 Jul 19 15:48:12.257218 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 265/469] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:48:12 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 1808 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:48:12.261941 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-2961c5ff-256c-44b7-b967-608adf323d4b tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:12.262599 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-2961c5ff-256c-44b7-b967-608adf323d4b tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] [instance: 17f9fd89-e668-4d3d-8d85-e648189ba0c2] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:12.269961 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-2961c5ff-256c-44b7-b967-608adf323d4b tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:12.270461 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-2961c5ff-256c-44b7-b967-608adf323d4b tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:12.271298 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-2961c5ff-256c-44b7-b967-608adf323d4b tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:12.271774 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-2961c5ff-256c-44b7-b967-608adf323d4b tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:12.412246 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-2961c5ff-256c-44b7-b967-608adf323d4b tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae334c4d93cd4d3e94789a5985fcfa77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6827afcdf1f3481882f808dc01908a4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:12.419931 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-2961c5ff-256c-44b7-b967-608adf323d4b tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] 10.222.0.64 "GET /compute/v2.1/servers/17f9fd89-e668-4d3d-8d85-e648189ba0c2" status: 200 len: 1265 microversion: 2.1 time: 0.161672 Jul 19 15:48:12.420501 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 266/470] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:48:12 2022] GET /compute/v2.1/servers/17f9fd89-e668-4d3d-8d85-e648189ba0c2 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:48:12.665868 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-c19813f7-122c-42ab-a2a6-3ac8559ae53d tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:12.666511 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-c19813f7-122c-42ab-a2a6-3ac8559ae53d tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 0194ecf2-5e08-49b2-a4e9-185bf9b32e40] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:12.674825 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-c19813f7-122c-42ab-a2a6-3ac8559ae53d tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:12.675088 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-c19813f7-122c-42ab-a2a6-3ac8559ae53d tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:12.675869 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-c19813f7-122c-42ab-a2a6-3ac8559ae53d tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:12.676309 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-c19813f7-122c-42ab-a2a6-3ac8559ae53d tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:12.816826 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-c19813f7-122c-42ab-a2a6-3ac8559ae53d tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:12.824310 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-c19813f7-122c-42ab-a2a6-3ac8559ae53d tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40" status: 200 len: 1371 microversion: 2.1 time: 0.162639 Jul 19 15:48:12.824876 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 267/471] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:48:12 2022] GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40 => generated 1371 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:48:12.968350 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-0a323c4f-ae6f-4f1d-adea-f24f2d1a93c3 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:12.969005 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-0a323c4f-ae6f-4f1d-adea-f24f2d1a93c3 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: 78bc17d6-5509-446d-a843-99a70b397128] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:12.976309 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-0a323c4f-ae6f-4f1d-adea-f24f2d1a93c3 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:12.976749 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-0a323c4f-ae6f-4f1d-adea-f24f2d1a93c3 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:12.977504 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-0a323c4f-ae6f-4f1d-adea-f24f2d1a93c3 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:12.977935 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-0a323c4f-ae6f-4f1d-adea-f24f2d1a93c3 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:13.116655 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-0a323c4f-ae6f-4f1d-adea-f24f2d1a93c3 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7c42cf0bc84292bb0b7edb9f2e7fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a72d232f314a78b0e1c3f04b0ed682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:13.124347 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-0a323c4f-ae6f-4f1d-adea-f24f2d1a93c3 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/78bc17d6-5509-446d-a843-99a70b397128" status: 200 len: 1367 microversion: 2.1 time: 0.159768 Jul 19 15:48:13.125034 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 268/472] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:48:12 2022] GET /compute/v2.1/servers/78bc17d6-5509-446d-a843-99a70b397128 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:48:13.129807 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-db70704f-5cbd-4f22-a4c5-564cfa7f8647 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0eaf7f24-3c09-4af8-bb04-b73111979115", "device": "/dev/sdb"}} {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:48:13.131435 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-db70704f-5cbd-4f22-a4c5-564cfa7f8647 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] [instance: 4157bc30-5973-4e95-a9de-fa467709484e] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:13.137339 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-db70704f-5cbd-4f22-a4c5-564cfa7f8647 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:13.137794 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-db70704f-5cbd-4f22-a4c5-564cfa7f8647 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:13.138586 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-db70704f-5cbd-4f22-a4c5-564cfa7f8647 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:13.139029 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-db70704f-5cbd-4f22-a4c5-564cfa7f8647 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:13.707737 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-8422c5f0-28eb-4091-b918-33aa8051e5fa tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "POST /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.043380 Jul 19 15:48:13.710156 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 205/473] 10.222.0.64 () {60 vars in 1322 bytes} [Tue Jul 19 15:48:11 2022] POST /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519/os-volume_attachments => generated 194 bytes in 2045 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:48:13.713685 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-bf61313c-c682-43ed-905e-9bc8e0074d0a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:13.714396 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-bf61313c-c682-43ed-905e-9bc8e0074d0a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:13.721164 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-bf61313c-c682-43ed-905e-9bc8e0074d0a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:13.721703 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-bf61313c-c682-43ed-905e-9bc8e0074d0a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:13.722497 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-bf61313c-c682-43ed-905e-9bc8e0074d0a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:13.722939 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-bf61313c-c682-43ed-905e-9bc8e0074d0a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:13.856740 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-bf61313c-c682-43ed-905e-9bc8e0074d0a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:13.865577 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-bf61313c-c682-43ed-905e-9bc8e0074d0a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:13.867080 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-bf61313c-c682-43ed-905e-9bc8e0074d0a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:13.868225 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-bf61313c-c682-43ed-905e-9bc8e0074d0a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 200 len: 1808 microversion: 2.20 time: 0.158781 Jul 19 15:48:13.868775 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 206/474] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:48:13 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:48:13.873093 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-ef8669f9-c0df-4ed9-bf15-ecb90f004d69 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:13.873677 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-ef8669f9-c0df-4ed9-bf15-ecb90f004d69 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] [instance: 17f9fd89-e668-4d3d-8d85-e648189ba0c2] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:13.879872 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-ef8669f9-c0df-4ed9-bf15-ecb90f004d69 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:13.880340 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-ef8669f9-c0df-4ed9-bf15-ecb90f004d69 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:13.881090 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-ef8669f9-c0df-4ed9-bf15-ecb90f004d69 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:13.881520 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-ef8669f9-c0df-4ed9-bf15-ecb90f004d69 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:14.015249 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-ef8669f9-c0df-4ed9-bf15-ecb90f004d69 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae334c4d93cd4d3e94789a5985fcfa77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6827afcdf1f3481882f808dc01908a4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:14.023453 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-ef8669f9-c0df-4ed9-bf15-ecb90f004d69 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] 10.222.0.64 "GET /compute/v2.1/servers/17f9fd89-e668-4d3d-8d85-e648189ba0c2" status: 200 len: 1265 microversion: 2.1 time: 0.153713 Jul 19 15:48:14.024023 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 207/475] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:48:13 2022] GET /compute/v2.1/servers/17f9fd89-e668-4d3d-8d85-e648189ba0c2 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:48:14.028363 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-8eacb8e3-c643-40c9-86dd-cf876d5a0363 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:14.028950 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-8eacb8e3-c643-40c9-86dd-cf876d5a0363 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 0194ecf2-5e08-49b2-a4e9-185bf9b32e40] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:14.035342 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-8eacb8e3-c643-40c9-86dd-cf876d5a0363 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:14.035783 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-8eacb8e3-c643-40c9-86dd-cf876d5a0363 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:14.036529 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-8eacb8e3-c643-40c9-86dd-cf876d5a0363 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:14.037215 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-8eacb8e3-c643-40c9-86dd-cf876d5a0363 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:14.177724 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-8eacb8e3-c643-40c9-86dd-cf876d5a0363 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:14.185272 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-8eacb8e3-c643-40c9-86dd-cf876d5a0363 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40" status: 200 len: 1371 microversion: 2.1 time: 0.160322 Jul 19 15:48:14.185824 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 208/476] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:48:14 2022] GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40 => generated 1371 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:48:14.190932 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-3a9e05bb-8b8a-4cc0-9063-0c5f08f6acbf tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:14.191518 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-3a9e05bb-8b8a-4cc0-9063-0c5f08f6acbf tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: 78bc17d6-5509-446d-a843-99a70b397128] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:14.197332 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-3a9e05bb-8b8a-4cc0-9063-0c5f08f6acbf tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:14.197767 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-3a9e05bb-8b8a-4cc0-9063-0c5f08f6acbf tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:14.198545 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-3a9e05bb-8b8a-4cc0-9063-0c5f08f6acbf tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:14.198974 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-3a9e05bb-8b8a-4cc0-9063-0c5f08f6acbf tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:14.421896 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-3a9e05bb-8b8a-4cc0-9063-0c5f08f6acbf tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7c42cf0bc84292bb0b7edb9f2e7fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a72d232f314a78b0e1c3f04b0ed682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:14.431915 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-3a9e05bb-8b8a-4cc0-9063-0c5f08f6acbf tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/78bc17d6-5509-446d-a843-99a70b397128" status: 200 len: 1367 microversion: 2.1 time: 0.244915 Jul 19 15:48:14.432883 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 209/477] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:48:14 2022] GET /compute/v2.1/servers/78bc17d6-5509-446d-a843-99a70b397128 => generated 1367 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:48:14.459562 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-db70704f-5cbd-4f22-a4c5-564cfa7f8647 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] 10.222.0.64 "POST /compute/v2.1/servers/4157bc30-5973-4e95-a9de-fa467709484e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.333173 Jul 19 15:48:14.460373 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 269/478] 10.222.0.64 () {60 vars in 1322 bytes} [Tue Jul 19 15:48:13 2022] POST /compute/v2.1/servers/4157bc30-5973-4e95-a9de-fa467709484e/os-volume_attachments => generated 194 bytes in 1335 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:48:14.888687 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-af46cc74-36a3-4282-a38d-1f747b4ccfa3 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:14.889453 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-af46cc74-36a3-4282-a38d-1f747b4ccfa3 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:14.899944 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-af46cc74-36a3-4282-a38d-1f747b4ccfa3 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:14.900691 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-af46cc74-36a3-4282-a38d-1f747b4ccfa3 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:14.901645 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-af46cc74-36a3-4282-a38d-1f747b4ccfa3 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:14.902441 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-af46cc74-36a3-4282-a38d-1f747b4ccfa3 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:15.042111 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-c8d48716-d590-4de9-be23-33a58e343ca5 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:15.042861 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-c8d48716-d590-4de9-be23-33a58e343ca5 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] [instance: 17f9fd89-e668-4d3d-8d85-e648189ba0c2] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:15.049873 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-c8d48716-d590-4de9-be23-33a58e343ca5 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:15.050572 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-c8d48716-d590-4de9-be23-33a58e343ca5 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:15.051343 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-c8d48716-d590-4de9-be23-33a58e343ca5 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:15.051777 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-c8d48716-d590-4de9-be23-33a58e343ca5 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:15.123847 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-af46cc74-36a3-4282-a38d-1f747b4ccfa3 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:15.133240 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-af46cc74-36a3-4282-a38d-1f747b4ccfa3 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:15.134783 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-af46cc74-36a3-4282-a38d-1f747b4ccfa3 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:15.135940 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-af46cc74-36a3-4282-a38d-1f747b4ccfa3 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 200 len: 1808 microversion: 2.20 time: 0.252611 Jul 19 15:48:15.136503 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 210/479] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:48:14 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 1808 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:48:15.201095 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-c8d48716-d590-4de9-be23-33a58e343ca5 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae334c4d93cd4d3e94789a5985fcfa77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6827afcdf1f3481882f808dc01908a4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:15.203511 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-c1add987-145f-4644-ba06-83cff152602e tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:15.205211 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-c1add987-145f-4644-ba06-83cff152602e tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 0194ecf2-5e08-49b2-a4e9-185bf9b32e40] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:15.208773 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-c8d48716-d590-4de9-be23-33a58e343ca5 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] 10.222.0.64 "GET /compute/v2.1/servers/17f9fd89-e668-4d3d-8d85-e648189ba0c2" status: 200 len: 1265 microversion: 2.1 time: 0.171657 Jul 19 15:48:15.216755 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-c1add987-145f-4644-ba06-83cff152602e tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:15.217708 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-c1add987-145f-4644-ba06-83cff152602e tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:15.218155 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 270/480] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:48:15 2022] GET /compute/v2.1/servers/17f9fd89-e668-4d3d-8d85-e648189ba0c2 => generated 1265 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:48:15.220229 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-c1add987-145f-4644-ba06-83cff152602e tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:15.220876 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-c1add987-145f-4644-ba06-83cff152602e tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:15.418713 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-c1add987-145f-4644-ba06-83cff152602e tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:15.426302 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-c1add987-145f-4644-ba06-83cff152602e tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40" status: 200 len: 1371 microversion: 2.1 time: 0.227332 Jul 19 15:48:15.426882 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 211/481] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:48:15 2022] GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40 => generated 1371 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:48:15.449041 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-e365e706-89a4-4079-98c8-09a8c762a6e3 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:15.449573 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-e365e706-89a4-4079-98c8-09a8c762a6e3 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: 78bc17d6-5509-446d-a843-99a70b397128] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:15.456939 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-e365e706-89a4-4079-98c8-09a8c762a6e3 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:15.457385 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-e365e706-89a4-4079-98c8-09a8c762a6e3 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:15.458139 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-e365e706-89a4-4079-98c8-09a8c762a6e3 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:15.458622 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-e365e706-89a4-4079-98c8-09a8c762a6e3 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:15.607523 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-e365e706-89a4-4079-98c8-09a8c762a6e3 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7c42cf0bc84292bb0b7edb9f2e7fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a72d232f314a78b0e1c3f04b0ed682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:15.616349 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-e365e706-89a4-4079-98c8-09a8c762a6e3 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/78bc17d6-5509-446d-a843-99a70b397128" status: 200 len: 1556 microversion: 2.1 time: 0.171140 Jul 19 15:48:15.617140 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 271/482] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:48:15 2022] GET /compute/v2.1/servers/78bc17d6-5509-446d-a843-99a70b397128 => generated 1556 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:48:15.634183 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-a0650349-a7a0-4fce-af94-f324883989a0 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:15.634776 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-a0650349-a7a0-4fce-af94-f324883989a0 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: 78bc17d6-5509-446d-a843-99a70b397128] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:15.641915 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-a0650349-a7a0-4fce-af94-f324883989a0 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:15.642725 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-a0650349-a7a0-4fce-af94-f324883989a0 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:15.643507 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-a0650349-a7a0-4fce-af94-f324883989a0 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:15.643939 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-a0650349-a7a0-4fce-af94-f324883989a0 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:15.728770 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-a0650349-a7a0-4fce-af94-f324883989a0 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/78bc17d6-5509-446d-a843-99a70b397128/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.098453 Jul 19 15:48:15.729445 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 212/483] 10.222.0.64 () {58 vars in 1274 bytes} [Tue Jul 19 15:48:15 2022] GET /compute/v2.1/servers/78bc17d6-5509-446d-a843-99a70b397128/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:48:16.157773 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-358f754d-8f49-478f-beab-850c637b690c tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:16.158392 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-358f754d-8f49-478f-beab-850c637b690c tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:16.176074 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-358f754d-8f49-478f-beab-850c637b690c tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:16.179309 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-358f754d-8f49-478f-beab-850c637b690c tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:16.179309 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-358f754d-8f49-478f-beab-850c637b690c tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:16.179309 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-358f754d-8f49-478f-beab-850c637b690c tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:16.227346 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-1fa88909-0d12-4baa-88f4-d42897a46fd3 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:16.227945 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-1fa88909-0d12-4baa-88f4-d42897a46fd3 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] [instance: 17f9fd89-e668-4d3d-8d85-e648189ba0c2] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:16.233984 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-1fa88909-0d12-4baa-88f4-d42897a46fd3 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:16.234462 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-1fa88909-0d12-4baa-88f4-d42897a46fd3 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:16.235376 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-1fa88909-0d12-4baa-88f4-d42897a46fd3 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:16.235784 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-1fa88909-0d12-4baa-88f4-d42897a46fd3 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:16.447990 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-358f754d-8f49-478f-beab-850c637b690c tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:16.457901 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-358f754d-8f49-478f-beab-850c637b690c tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:16.459491 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-358f754d-8f49-478f-beab-850c637b690c tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:16.460722 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-358f754d-8f49-478f-beab-850c637b690c tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 200 len: 1808 microversion: 2.20 time: 0.307616 Jul 19 15:48:16.461288 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 272/484] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:48:16 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 1808 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:48:16.466870 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-addfa148-f62f-4ef5-a9c7-cc6920f87243 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:16.467847 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-addfa148-f62f-4ef5-a9c7-cc6920f87243 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 0194ecf2-5e08-49b2-a4e9-185bf9b32e40] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:16.475598 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-addfa148-f62f-4ef5-a9c7-cc6920f87243 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:16.476167 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-addfa148-f62f-4ef5-a9c7-cc6920f87243 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:16.477017 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-addfa148-f62f-4ef5-a9c7-cc6920f87243 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:16.477525 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-addfa148-f62f-4ef5-a9c7-cc6920f87243 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:16.730750 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-addfa148-f62f-4ef5-a9c7-cc6920f87243 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:16.741051 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-addfa148-f62f-4ef5-a9c7-cc6920f87243 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40" status: 200 len: 1565 microversion: 2.1 time: 0.278468 Jul 19 15:48:16.746272 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 273/485] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:48:16 2022] GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40 => generated 1565 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:48:16.746442 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-1fa88909-0d12-4baa-88f4-d42897a46fd3 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae334c4d93cd4d3e94789a5985fcfa77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6827afcdf1f3481882f808dc01908a4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:16.755281 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-1fa88909-0d12-4baa-88f4-d42897a46fd3 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] 10.222.0.64 "GET /compute/v2.1/servers/17f9fd89-e668-4d3d-8d85-e648189ba0c2" status: 200 len: 1265 microversion: 2.1 time: 0.532878 Jul 19 15:48:16.756241 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 213/486] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:48:16 2022] GET /compute/v2.1/servers/17f9fd89-e668-4d3d-8d85-e648189ba0c2 => generated 1265 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:48:16.766073 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-6ccb2205-1954-4fdb-9235-6dc497ecd144 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:16.766837 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-6ccb2205-1954-4fdb-9235-6dc497ecd144 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 0194ecf2-5e08-49b2-a4e9-185bf9b32e40] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:16.772909 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-6ccb2205-1954-4fdb-9235-6dc497ecd144 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:16.773463 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-6ccb2205-1954-4fdb-9235-6dc497ecd144 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:16.774297 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-6ccb2205-1954-4fdb-9235-6dc497ecd144 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:16.774828 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-6ccb2205-1954-4fdb-9235-6dc497ecd144 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:16.889065 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-6ccb2205-1954-4fdb-9235-6dc497ecd144 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.134295 Jul 19 15:48:16.890033 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 274/487] 10.222.0.64 () {58 vars in 1274 bytes} [Tue Jul 19 15:48:16 2022] GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40/os-interface => generated 285 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:48:17.347408 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [req-c9c6a17d-1b29-418a-b42a-1e0890057fe1 req-6f1fd9ae-6870-4ebc-80a1-0e6dd9e151a5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "78bc17d6-5509-446d-a843-99a70b397128", "tag": "41689fce-682e-44b2-a26f-83d31eb3790b"}]} {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:48:17.356370 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [req-c9c6a17d-1b29-418a-b42a-1e0890057fe1 req-6f1fd9ae-6870-4ebc-80a1-0e6dd9e151a5 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:17.356821 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [req-c9c6a17d-1b29-418a-b42a-1e0890057fe1 req-6f1fd9ae-6870-4ebc-80a1-0e6dd9e151a5 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:17.369663 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.compute.server_external_events [req-c9c6a17d-1b29-418a-b42a-1e0890057fe1 req-6f1fd9ae-6870-4ebc-80a1-0e6dd9e151a5 service nova] Creating event network-changed:41689fce-682e-44b2-a26f-83d31eb3790b for instance 78bc17d6-5509-446d-a843-99a70b397128 on hv-cinder-84902 Jul 19 15:48:17.374605 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [req-c9c6a17d-1b29-418a-b42a-1e0890057fe1 req-6f1fd9ae-6870-4ebc-80a1-0e6dd9e151a5 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031398 Jul 19 15:48:17.375197 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 214/488] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Jul 19 15:48:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 15:48:17.481362 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-828fe4c0-176e-4ed2-9185-3f0a16fe6b5f tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:17.481998 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-828fe4c0-176e-4ed2-9185-3f0a16fe6b5f tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:17.499522 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-828fe4c0-176e-4ed2-9185-3f0a16fe6b5f tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:17.500004 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-828fe4c0-176e-4ed2-9185-3f0a16fe6b5f tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:17.503267 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-828fe4c0-176e-4ed2-9185-3f0a16fe6b5f tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:17.503712 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-828fe4c0-176e-4ed2-9185-3f0a16fe6b5f tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:17.763863 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-828fe4c0-176e-4ed2-9185-3f0a16fe6b5f tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:17.768480 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG dbcounter [-] [129520] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:48:17.773414 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-b46d1e5f-c253-42d4-8bf0-bf4b7258e261 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:17.774443 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-b46d1e5f-c253-42d4-8bf0-bf4b7258e261 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] [instance: 17f9fd89-e668-4d3d-8d85-e648189ba0c2] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:17.778635 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-828fe4c0-176e-4ed2-9185-3f0a16fe6b5f tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:17.782245 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-828fe4c0-176e-4ed2-9185-3f0a16fe6b5f tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:17.782928 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-b46d1e5f-c253-42d4-8bf0-bf4b7258e261 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:17.783732 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-828fe4c0-176e-4ed2-9185-3f0a16fe6b5f tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 200 len: 1808 microversion: 2.20 time: 0.307617 Jul 19 15:48:17.784220 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-b46d1e5f-c253-42d4-8bf0-bf4b7258e261 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:17.784701 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 275/489] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:48:17 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 1808 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:48:17.785783 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-b46d1e5f-c253-42d4-8bf0-bf4b7258e261 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:17.786294 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-b46d1e5f-c253-42d4-8bf0-bf4b7258e261 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:18.026694 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-b46d1e5f-c253-42d4-8bf0-bf4b7258e261 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae334c4d93cd4d3e94789a5985fcfa77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6827afcdf1f3481882f808dc01908a4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:18.042675 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-b46d1e5f-c253-42d4-8bf0-bf4b7258e261 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] 10.222.0.64 "GET /compute/v2.1/servers/17f9fd89-e668-4d3d-8d85-e648189ba0c2" status: 200 len: 1265 microversion: 2.1 time: 0.273491 Jul 19 15:48:18.043415 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 215/490] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:48:17 2022] GET /compute/v2.1/servers/17f9fd89-e668-4d3d-8d85-e648189ba0c2 => generated 1265 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:48:18.802998 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-d9bffa80-d9d0-4760-83ed-e2d83e750136 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:18.803614 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-d9bffa80-d9d0-4760-83ed-e2d83e750136 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:18.811697 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-d9bffa80-d9d0-4760-83ed-e2d83e750136 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:18.812129 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-d9bffa80-d9d0-4760-83ed-e2d83e750136 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:18.813448 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-d9bffa80-d9d0-4760-83ed-e2d83e750136 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:18.814080 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-d9bffa80-d9d0-4760-83ed-e2d83e750136 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:18.958824 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-d9bffa80-d9d0-4760-83ed-e2d83e750136 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:18.967220 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-d9bffa80-d9d0-4760-83ed-e2d83e750136 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:18.968753 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-d9bffa80-d9d0-4760-83ed-e2d83e750136 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:18.970411 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-d9bffa80-d9d0-4760-83ed-e2d83e750136 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 200 len: 1808 microversion: 2.20 time: 0.171395 Jul 19 15:48:18.970987 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 276/491] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:48:18 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 1808 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:48:19.060126 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-fdbc0736-59ec-47ea-a1d4-90db7c08d3c0 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:19.060753 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-fdbc0736-59ec-47ea-a1d4-90db7c08d3c0 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] [instance: 17f9fd89-e668-4d3d-8d85-e648189ba0c2] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:19.067731 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-fdbc0736-59ec-47ea-a1d4-90db7c08d3c0 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:19.068175 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-fdbc0736-59ec-47ea-a1d4-90db7c08d3c0 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:19.068934 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-fdbc0736-59ec-47ea-a1d4-90db7c08d3c0 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:19.069363 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-fdbc0736-59ec-47ea-a1d4-90db7c08d3c0 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:19.243082 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-fdbc0736-59ec-47ea-a1d4-90db7c08d3c0 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae334c4d93cd4d3e94789a5985fcfa77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6827afcdf1f3481882f808dc01908a4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:19.250531 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-13d547a1-8b7a-473f-8c4f-65ad1d2f5829 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:48:19.255642 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-fdbc0736-59ec-47ea-a1d4-90db7c08d3c0 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] 10.222.0.64 "GET /compute/v2.1/servers/17f9fd89-e668-4d3d-8d85-e648189ba0c2" status: 200 len: 1265 microversion: 2.1 time: 0.199250 Jul 19 15:48:19.258445 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 216/492] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:48:19 2022] GET /compute/v2.1/servers/17f9fd89-e668-4d3d-8d85-e648189ba0c2 => generated 1265 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:48:19.258658 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-13d547a1-8b7a-473f-8c4f-65ad1d2f5829 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:19.258832 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-13d547a1-8b7a-473f-8c4f-65ad1d2f5829 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:19.327846 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-13d547a1-8b7a-473f-8c4f-65ad1d2f5829 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 343ae383-5bfd-4c70-8926-a800fcee3519] Going to try to stop instance {{(pid=129520) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 19 15:48:19.377572 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-13d547a1-8b7a-473f-8c4f-65ad1d2f5829 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "POST /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519/action" status: 202 len: 0 microversion: 2.1 time: 0.130774 Jul 19 15:48:19.378431 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 277/493] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Jul 19 15:48:19 2022] POST /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 15:48:19.386960 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-1ee6700c-6fb8-4cde-89b4-6581898e9ca0 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:19.387937 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-1ee6700c-6fb8-4cde-89b4-6581898e9ca0 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 343ae383-5bfd-4c70-8926-a800fcee3519] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:19.393466 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [req-f34dc48e-4103-43cb-ba5d-fdb3ea0d511a req-c85791ca-710b-4f24-a46f-f2fdd078f383 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0194ecf2-5e08-49b2-a4e9-185bf9b32e40", "tag": "588a9a7a-f29d-40a2-abf8-161404100f96"}]} {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:48:19.395248 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-1ee6700c-6fb8-4cde-89b4-6581898e9ca0 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:19.395892 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-1ee6700c-6fb8-4cde-89b4-6581898e9ca0 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:19.396796 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-1ee6700c-6fb8-4cde-89b4-6581898e9ca0 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:19.397538 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-1ee6700c-6fb8-4cde-89b4-6581898e9ca0 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:19.403099 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [req-f34dc48e-4103-43cb-ba5d-fdb3ea0d511a req-c85791ca-710b-4f24-a46f-f2fdd078f383 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:19.403732 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [req-f34dc48e-4103-43cb-ba5d-fdb3ea0d511a req-c85791ca-710b-4f24-a46f-f2fdd078f383 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:19.416492 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.compute.server_external_events [req-f34dc48e-4103-43cb-ba5d-fdb3ea0d511a req-c85791ca-710b-4f24-a46f-f2fdd078f383 service nova] Creating event network-changed:588a9a7a-f29d-40a2-abf8-161404100f96 for instance 0194ecf2-5e08-49b2-a4e9-185bf9b32e40 on hv-cinder-84902 Jul 19 15:48:19.421325 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [req-f34dc48e-4103-43cb-ba5d-fdb3ea0d511a req-c85791ca-710b-4f24-a46f-f2fdd078f383 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032777 Jul 19 15:48:19.421921 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 278/494] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Jul 19 15:48:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 15:48:19.545332 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-1ee6700c-6fb8-4cde-89b4-6581898e9ca0 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c75043813844d79fd0764132dfe4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e234f713b40cd8772372c2316dd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:19.554452 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-1ee6700c-6fb8-4cde-89b4-6581898e9ca0 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519" status: 200 len: 1724 microversion: 2.1 time: 0.171465 Jul 19 15:48:19.555036 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 217/495] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:48:19 2022] GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519 => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:48:19.990409 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-98f2b5f7-a67b-44f9-bad7-1dd83a112cda tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:19.991008 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-98f2b5f7-a67b-44f9-bad7-1dd83a112cda tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:19.997240 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-98f2b5f7-a67b-44f9-bad7-1dd83a112cda tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:19.997681 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-98f2b5f7-a67b-44f9-bad7-1dd83a112cda tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:19.998454 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-98f2b5f7-a67b-44f9-bad7-1dd83a112cda tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:19.998880 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-98f2b5f7-a67b-44f9-bad7-1dd83a112cda tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:20.133149 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-98f2b5f7-a67b-44f9-bad7-1dd83a112cda tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:20.142282 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-98f2b5f7-a67b-44f9-bad7-1dd83a112cda tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:20.143811 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-98f2b5f7-a67b-44f9-bad7-1dd83a112cda tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:20.144947 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-98f2b5f7-a67b-44f9-bad7-1dd83a112cda tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 200 len: 1808 microversion: 2.20 time: 0.159982 Jul 19 15:48:20.145490 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 279/496] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:48:19 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 1808 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:48:20.273581 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-2cc1394c-b78c-46bc-ae43-2f0b568b9b41 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:20.274105 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-2cc1394c-b78c-46bc-ae43-2f0b568b9b41 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] [instance: 17f9fd89-e668-4d3d-8d85-e648189ba0c2] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:20.280680 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-2cc1394c-b78c-46bc-ae43-2f0b568b9b41 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:20.281131 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-2cc1394c-b78c-46bc-ae43-2f0b568b9b41 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:20.281932 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-2cc1394c-b78c-46bc-ae43-2f0b568b9b41 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:20.282382 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-2cc1394c-b78c-46bc-ae43-2f0b568b9b41 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:20.416021 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-2cc1394c-b78c-46bc-ae43-2f0b568b9b41 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae334c4d93cd4d3e94789a5985fcfa77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6827afcdf1f3481882f808dc01908a4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:20.424072 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-2cc1394c-b78c-46bc-ae43-2f0b568b9b41 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] 10.222.0.64 "GET /compute/v2.1/servers/17f9fd89-e668-4d3d-8d85-e648189ba0c2" status: 200 len: 1265 microversion: 2.1 time: 0.154739 Jul 19 15:48:20.424626 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 218/497] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:48:20 2022] GET /compute/v2.1/servers/17f9fd89-e668-4d3d-8d85-e648189ba0c2 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:48:20.572293 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-09dfb746-a09f-4cd3-957e-f7645318a9b7 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:20.572809 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-09dfb746-a09f-4cd3-957e-f7645318a9b7 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 343ae383-5bfd-4c70-8926-a800fcee3519] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:20.579313 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-09dfb746-a09f-4cd3-957e-f7645318a9b7 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:20.579835 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-09dfb746-a09f-4cd3-957e-f7645318a9b7 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:20.580585 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-09dfb746-a09f-4cd3-957e-f7645318a9b7 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:20.581013 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-09dfb746-a09f-4cd3-957e-f7645318a9b7 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:20.709098 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-09dfb746-a09f-4cd3-957e-f7645318a9b7 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c75043813844d79fd0764132dfe4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e234f713b40cd8772372c2316dd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:20.717006 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-09dfb746-a09f-4cd3-957e-f7645318a9b7 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519" status: 200 len: 1724 microversion: 2.1 time: 0.148598 Jul 19 15:48:20.717570 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 280/498] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:48:20 2022] GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519 => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:48:21.163470 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-d209f2c0-8c68-44e7-bfd9-833fc803398c tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:21.163986 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-d209f2c0-8c68-44e7-bfd9-833fc803398c tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:21.169935 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-d209f2c0-8c68-44e7-bfd9-833fc803398c tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:21.170402 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-d209f2c0-8c68-44e7-bfd9-833fc803398c tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:21.171159 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-d209f2c0-8c68-44e7-bfd9-833fc803398c tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:21.171591 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-d209f2c0-8c68-44e7-bfd9-833fc803398c tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:21.381335 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-d209f2c0-8c68-44e7-bfd9-833fc803398c tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:21.389733 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-d209f2c0-8c68-44e7-bfd9-833fc803398c tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:21.391355 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-d209f2c0-8c68-44e7-bfd9-833fc803398c tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:21.392504 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-d209f2c0-8c68-44e7-bfd9-833fc803398c tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 200 len: 1808 microversion: 2.20 time: 0.233296 Jul 19 15:48:21.393068 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 219/499] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:48:21 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 1808 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:48:21.441537 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-3dd5bce0-4d21-412e-8dc4-0d6e92ff2547 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:21.442229 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-3dd5bce0-4d21-412e-8dc4-0d6e92ff2547 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] [instance: 17f9fd89-e668-4d3d-8d85-e648189ba0c2] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:21.448918 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-3dd5bce0-4d21-412e-8dc4-0d6e92ff2547 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:21.449359 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-3dd5bce0-4d21-412e-8dc4-0d6e92ff2547 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:21.450115 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-3dd5bce0-4d21-412e-8dc4-0d6e92ff2547 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:21.450573 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-3dd5bce0-4d21-412e-8dc4-0d6e92ff2547 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:21.591540 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-3dd5bce0-4d21-412e-8dc4-0d6e92ff2547 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae334c4d93cd4d3e94789a5985fcfa77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6827afcdf1f3481882f808dc01908a4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:21.599338 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-3dd5bce0-4d21-412e-8dc4-0d6e92ff2547 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] 10.222.0.64 "GET /compute/v2.1/servers/17f9fd89-e668-4d3d-8d85-e648189ba0c2" status: 200 len: 1265 microversion: 2.1 time: 0.162517 Jul 19 15:48:21.599899 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 281/500] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:48:21 2022] GET /compute/v2.1/servers/17f9fd89-e668-4d3d-8d85-e648189ba0c2 => generated 1265 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:48:21.735797 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-dd5d24fd-38a4-419c-bea9-6160e2a430ff tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:21.736393 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-dd5d24fd-38a4-419c-bea9-6160e2a430ff tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 343ae383-5bfd-4c70-8926-a800fcee3519] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:21.742501 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-dd5d24fd-38a4-419c-bea9-6160e2a430ff tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:21.742945 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-dd5d24fd-38a4-419c-bea9-6160e2a430ff tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:21.743689 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-dd5d24fd-38a4-419c-bea9-6160e2a430ff tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:21.744115 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-dd5d24fd-38a4-419c-bea9-6160e2a430ff tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:21.874540 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-dd5d24fd-38a4-419c-bea9-6160e2a430ff tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c75043813844d79fd0764132dfe4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e234f713b40cd8772372c2316dd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:21.882931 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-dd5d24fd-38a4-419c-bea9-6160e2a430ff tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519" status: 200 len: 1724 microversion: 2.1 time: 0.151619 Jul 19 15:48:21.883497 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 220/501] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:48:21 2022] GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:48:22.410611 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-2c61c929-054b-4bd1-bd60-0e6619ad65a8 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:22.411222 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-2c61c929-054b-4bd1-bd60-0e6619ad65a8 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:22.417903 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-2c61c929-054b-4bd1-bd60-0e6619ad65a8 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:22.418345 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-2c61c929-054b-4bd1-bd60-0e6619ad65a8 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:22.419124 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-2c61c929-054b-4bd1-bd60-0e6619ad65a8 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:22.419551 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-2c61c929-054b-4bd1-bd60-0e6619ad65a8 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:22.547513 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-2c61c929-054b-4bd1-bd60-0e6619ad65a8 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:22.556173 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-2c61c929-054b-4bd1-bd60-0e6619ad65a8 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:22.557670 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-2c61c929-054b-4bd1-bd60-0e6619ad65a8 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:22.558843 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-2c61c929-054b-4bd1-bd60-0e6619ad65a8 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 200 len: 1808 microversion: 2.20 time: 0.152186 Jul 19 15:48:22.559398 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 282/502] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:48:22 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 1808 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:48:22.614967 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-6bdb74ca-2d41-4512-b9f8-a7388f86079c tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:22.615568 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-6bdb74ca-2d41-4512-b9f8-a7388f86079c tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] [instance: 17f9fd89-e668-4d3d-8d85-e648189ba0c2] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:22.621987 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-6bdb74ca-2d41-4512-b9f8-a7388f86079c tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:22.622469 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-6bdb74ca-2d41-4512-b9f8-a7388f86079c tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:22.623219 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-6bdb74ca-2d41-4512-b9f8-a7388f86079c tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:22.623650 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-6bdb74ca-2d41-4512-b9f8-a7388f86079c tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:22.754418 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-6bdb74ca-2d41-4512-b9f8-a7388f86079c tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae334c4d93cd4d3e94789a5985fcfa77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6827afcdf1f3481882f808dc01908a4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:22.757917 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG dbcounter [-] [129519] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:48:22.762962 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-6bdb74ca-2d41-4512-b9f8-a7388f86079c tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] 10.222.0.64 "GET /compute/v2.1/servers/17f9fd89-e668-4d3d-8d85-e648189ba0c2" status: 200 len: 1265 microversion: 2.1 time: 0.151789 Jul 19 15:48:22.763530 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 221/503] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:48:22 2022] GET /compute/v2.1/servers/17f9fd89-e668-4d3d-8d85-e648189ba0c2 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:48:22.900467 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-fcf33e54-e025-4987-9c7d-a98e4835356b tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:22.901062 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-fcf33e54-e025-4987-9c7d-a98e4835356b tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 343ae383-5bfd-4c70-8926-a800fcee3519] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:22.908466 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-fcf33e54-e025-4987-9c7d-a98e4835356b tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:22.908906 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-fcf33e54-e025-4987-9c7d-a98e4835356b tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:22.909654 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-fcf33e54-e025-4987-9c7d-a98e4835356b tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:22.910085 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-fcf33e54-e025-4987-9c7d-a98e4835356b tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:23.054374 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-fcf33e54-e025-4987-9c7d-a98e4835356b tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c75043813844d79fd0764132dfe4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e234f713b40cd8772372c2316dd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:23.062455 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-fcf33e54-e025-4987-9c7d-a98e4835356b tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519" status: 200 len: 1724 microversion: 2.1 time: 0.165866 Jul 19 15:48:23.063608 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 283/504] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:48:22 2022] GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:48:23.577768 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-ff32e315-f713-4327-b251-a7134fc25929 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:23.578383 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-ff32e315-f713-4327-b251-a7134fc25929 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:23.585918 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-ff32e315-f713-4327-b251-a7134fc25929 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:23.586377 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-ff32e315-f713-4327-b251-a7134fc25929 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:23.587161 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-ff32e315-f713-4327-b251-a7134fc25929 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:23.587591 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-ff32e315-f713-4327-b251-a7134fc25929 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:23.724759 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-ff32e315-f713-4327-b251-a7134fc25929 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:23.733141 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-ff32e315-f713-4327-b251-a7134fc25929 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:23.734833 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-ff32e315-f713-4327-b251-a7134fc25929 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:23.735990 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-ff32e315-f713-4327-b251-a7134fc25929 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 200 len: 1808 microversion: 2.20 time: 0.162840 Jul 19 15:48:23.736542 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 222/505] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:48:23 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:48:23.780195 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-e5ab3032-614d-4357-b292-1407c9a931de tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:23.780727 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-e5ab3032-614d-4357-b292-1407c9a931de tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] [instance: 17f9fd89-e668-4d3d-8d85-e648189ba0c2] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:23.788266 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-e5ab3032-614d-4357-b292-1407c9a931de tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:23.788710 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-e5ab3032-614d-4357-b292-1407c9a931de tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:23.789464 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-e5ab3032-614d-4357-b292-1407c9a931de tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:23.789892 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-e5ab3032-614d-4357-b292-1407c9a931de tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:23.920542 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-e5ab3032-614d-4357-b292-1407c9a931de tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae334c4d93cd4d3e94789a5985fcfa77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6827afcdf1f3481882f808dc01908a4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:23.928611 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-e5ab3032-614d-4357-b292-1407c9a931de tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] 10.222.0.64 "GET /compute/v2.1/servers/17f9fd89-e668-4d3d-8d85-e648189ba0c2" status: 200 len: 1265 microversion: 2.1 time: 0.152322 Jul 19 15:48:23.929183 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 284/506] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:48:23 2022] GET /compute/v2.1/servers/17f9fd89-e668-4d3d-8d85-e648189ba0c2 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:48:24.079346 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-a1df912c-dcc3-4607-b523-6c7e5ad50a88 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:24.079949 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-a1df912c-dcc3-4607-b523-6c7e5ad50a88 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 343ae383-5bfd-4c70-8926-a800fcee3519] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:24.085873 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-a1df912c-dcc3-4607-b523-6c7e5ad50a88 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:24.086320 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-a1df912c-dcc3-4607-b523-6c7e5ad50a88 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:24.087105 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-a1df912c-dcc3-4607-b523-6c7e5ad50a88 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:24.087539 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-a1df912c-dcc3-4607-b523-6c7e5ad50a88 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:24.223787 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-a1df912c-dcc3-4607-b523-6c7e5ad50a88 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c75043813844d79fd0764132dfe4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e234f713b40cd8772372c2316dd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:24.231710 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-a1df912c-dcc3-4607-b523-6c7e5ad50a88 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519" status: 200 len: 1724 microversion: 2.1 time: 0.156184 Jul 19 15:48:24.232277 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 223/507] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:48:24 2022] GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:48:24.756144 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-418cf694-c48a-4a24-bd3f-3eccf2c00608 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:24.757159 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-418cf694-c48a-4a24-bd3f-3eccf2c00608 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:24.763274 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-418cf694-c48a-4a24-bd3f-3eccf2c00608 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:24.763723 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-418cf694-c48a-4a24-bd3f-3eccf2c00608 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:24.764492 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-418cf694-c48a-4a24-bd3f-3eccf2c00608 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:24.764929 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-418cf694-c48a-4a24-bd3f-3eccf2c00608 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:24.911888 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-418cf694-c48a-4a24-bd3f-3eccf2c00608 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:24.921028 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-418cf694-c48a-4a24-bd3f-3eccf2c00608 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:24.922986 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-418cf694-c48a-4a24-bd3f-3eccf2c00608 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:24.924216 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-418cf694-c48a-4a24-bd3f-3eccf2c00608 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 200 len: 1808 microversion: 2.20 time: 0.174748 Jul 19 15:48:24.924774 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 285/508] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:48:24 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 1808 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:48:24.945730 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-7add4996-e94f-48ae-95f4-76ed7c6ec831 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:24.946338 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-7add4996-e94f-48ae-95f4-76ed7c6ec831 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] [instance: 17f9fd89-e668-4d3d-8d85-e648189ba0c2] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:24.953418 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-7add4996-e94f-48ae-95f4-76ed7c6ec831 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:24.954421 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-7add4996-e94f-48ae-95f4-76ed7c6ec831 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:24.955184 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-7add4996-e94f-48ae-95f4-76ed7c6ec831 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:24.955615 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-7add4996-e94f-48ae-95f4-76ed7c6ec831 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:25.098077 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-7add4996-e94f-48ae-95f4-76ed7c6ec831 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae334c4d93cd4d3e94789a5985fcfa77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6827afcdf1f3481882f808dc01908a4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:25.106042 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-7add4996-e94f-48ae-95f4-76ed7c6ec831 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] 10.222.0.64 "GET /compute/v2.1/servers/17f9fd89-e668-4d3d-8d85-e648189ba0c2" status: 200 len: 1265 microversion: 2.1 time: 0.164138 Jul 19 15:48:25.106806 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 224/509] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:48:24 2022] GET /compute/v2.1/servers/17f9fd89-e668-4d3d-8d85-e648189ba0c2 => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:48:25.249796 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-fc6cd71a-ff30-4dd0-a417-51c5b1354769 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:25.251399 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-fc6cd71a-ff30-4dd0-a417-51c5b1354769 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 343ae383-5bfd-4c70-8926-a800fcee3519] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:25.253250 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [req-6ae99191-a31d-44f0-aef8-99bd590a3fe9 req-1396e6fd-2d3e-4b39-af42-0defab028380 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3eeb4a51-a06c-4faf-9a63-bf3658ca773b", "name": "network-vif-plugged", "status": "completed", "tag": "61483d93-6fa5-46d1-b820-a274f98ffcbb"}]} {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:48:25.257864 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-fc6cd71a-ff30-4dd0-a417-51c5b1354769 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:25.258403 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-fc6cd71a-ff30-4dd0-a417-51c5b1354769 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:25.259284 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-fc6cd71a-ff30-4dd0-a417-51c5b1354769 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:25.259774 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-fc6cd71a-ff30-4dd0-a417-51c5b1354769 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:25.262428 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [req-6ae99191-a31d-44f0-aef8-99bd590a3fe9 req-1396e6fd-2d3e-4b39-af42-0defab028380 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:25.263117 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [req-6ae99191-a31d-44f0-aef8-99bd590a3fe9 req-1396e6fd-2d3e-4b39-af42-0defab028380 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:25.274817 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.compute.server_external_events [req-6ae99191-a31d-44f0-aef8-99bd590a3fe9 req-1396e6fd-2d3e-4b39-af42-0defab028380 service nova] Creating event network-vif-plugged:61483d93-6fa5-46d1-b820-a274f98ffcbb for instance 3eeb4a51-a06c-4faf-9a63-bf3658ca773b on hv-cinder-84902 Jul 19 15:48:25.282290 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [req-6ae99191-a31d-44f0-aef8-99bd590a3fe9 req-1396e6fd-2d3e-4b39-af42-0defab028380 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031962 Jul 19 15:48:25.283704 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 225/510] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Jul 19 15:48:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:48:25.419737 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-fc6cd71a-ff30-4dd0-a417-51c5b1354769 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c75043813844d79fd0764132dfe4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e234f713b40cd8772372c2316dd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:25.428299 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-fc6cd71a-ff30-4dd0-a417-51c5b1354769 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519" status: 200 len: 1724 microversion: 2.1 time: 0.182510 Jul 19 15:48:25.428871 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 286/511] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:48:25 2022] GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519 => generated 1724 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:48:25.942848 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-4d121c82-cd64-44a8-a9b1-ae5c05a66d85 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:25.943703 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-4d121c82-cd64-44a8-a9b1-ae5c05a66d85 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:25.950505 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-4d121c82-cd64-44a8-a9b1-ae5c05a66d85 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:25.951075 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-4d121c82-cd64-44a8-a9b1-ae5c05a66d85 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:25.951723 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-4d121c82-cd64-44a8-a9b1-ae5c05a66d85 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:25.952146 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-4d121c82-cd64-44a8-a9b1-ae5c05a66d85 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:26.081689 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-4d121c82-cd64-44a8-a9b1-ae5c05a66d85 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:26.090061 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-4d121c82-cd64-44a8-a9b1-ae5c05a66d85 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:26.091608 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-4d121c82-cd64-44a8-a9b1-ae5c05a66d85 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:26.092757 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-4d121c82-cd64-44a8-a9b1-ae5c05a66d85 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 200 len: 1808 microversion: 2.20 time: 0.154601 Jul 19 15:48:26.093317 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 226/512] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:48:25 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 1808 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:48:26.123285 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-879a4e95-bff6-42f3-b222-585235acf748 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:26.124024 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-879a4e95-bff6-42f3-b222-585235acf748 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] [instance: 17f9fd89-e668-4d3d-8d85-e648189ba0c2] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:26.131095 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-879a4e95-bff6-42f3-b222-585235acf748 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:26.131543 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-879a4e95-bff6-42f3-b222-585235acf748 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:26.132303 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-879a4e95-bff6-42f3-b222-585235acf748 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:26.132739 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-879a4e95-bff6-42f3-b222-585235acf748 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:26.267600 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-879a4e95-bff6-42f3-b222-585235acf748 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae334c4d93cd4d3e94789a5985fcfa77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6827afcdf1f3481882f808dc01908a4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:26.275007 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-879a4e95-bff6-42f3-b222-585235acf748 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] 10.222.0.64 "GET /compute/v2.1/servers/17f9fd89-e668-4d3d-8d85-e648189ba0c2" status: 200 len: 1265 microversion: 2.1 time: 0.155475 Jul 19 15:48:26.275572 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 287/513] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:48:26 2022] GET /compute/v2.1/servers/17f9fd89-e668-4d3d-8d85-e648189ba0c2 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:48:26.446664 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-31378b47-c02c-41a0-853a-fb6d76b724b3 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:26.447279 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-31378b47-c02c-41a0-853a-fb6d76b724b3 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 343ae383-5bfd-4c70-8926-a800fcee3519] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:26.454297 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-31378b47-c02c-41a0-853a-fb6d76b724b3 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:26.454785 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-31378b47-c02c-41a0-853a-fb6d76b724b3 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:26.455553 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-31378b47-c02c-41a0-853a-fb6d76b724b3 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:26.455994 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-31378b47-c02c-41a0-853a-fb6d76b724b3 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:26.587874 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-31378b47-c02c-41a0-853a-fb6d76b724b3 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c75043813844d79fd0764132dfe4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e234f713b40cd8772372c2316dd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:26.595879 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-31378b47-c02c-41a0-853a-fb6d76b724b3 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519" status: 200 len: 1724 microversion: 2.1 time: 0.153648 Jul 19 15:48:26.596447 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 227/514] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:48:26 2022] GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:48:27.111813 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-ee26777f-19c6-45dc-b80f-abed32b0ee6d tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:27.112415 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-ee26777f-19c6-45dc-b80f-abed32b0ee6d tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:27.118489 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-ee26777f-19c6-45dc-b80f-abed32b0ee6d tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:27.118939 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-ee26777f-19c6-45dc-b80f-abed32b0ee6d tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:27.119694 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-ee26777f-19c6-45dc-b80f-abed32b0ee6d tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:27.120127 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-ee26777f-19c6-45dc-b80f-abed32b0ee6d tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:27.251028 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-ee26777f-19c6-45dc-b80f-abed32b0ee6d tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:27.259891 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-ee26777f-19c6-45dc-b80f-abed32b0ee6d tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:27.261404 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-ee26777f-19c6-45dc-b80f-abed32b0ee6d tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:27.262621 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-ee26777f-19c6-45dc-b80f-abed32b0ee6d tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 200 len: 1808 microversion: 2.20 time: 0.155428 Jul 19 15:48:27.263185 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 288/515] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:48:27 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 1808 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:48:27.292900 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-475b81fe-3aa3-4a78-9234-306783720902 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:27.293507 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-475b81fe-3aa3-4a78-9234-306783720902 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] [instance: 17f9fd89-e668-4d3d-8d85-e648189ba0c2] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:27.300726 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-475b81fe-3aa3-4a78-9234-306783720902 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:27.301176 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-475b81fe-3aa3-4a78-9234-306783720902 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:27.301945 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-475b81fe-3aa3-4a78-9234-306783720902 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:27.302397 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-475b81fe-3aa3-4a78-9234-306783720902 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:27.432351 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-475b81fe-3aa3-4a78-9234-306783720902 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae334c4d93cd4d3e94789a5985fcfa77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6827afcdf1f3481882f808dc01908a4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:27.440833 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-475b81fe-3aa3-4a78-9234-306783720902 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] 10.222.0.64 "GET /compute/v2.1/servers/17f9fd89-e668-4d3d-8d85-e648189ba0c2" status: 200 len: 1265 microversion: 2.1 time: 0.151658 Jul 19 15:48:27.441415 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 228/516] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:48:27 2022] GET /compute/v2.1/servers/17f9fd89-e668-4d3d-8d85-e648189ba0c2 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:48:27.613430 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-1fc3c294-aec7-474b-bc08-0f090511486e tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:27.614031 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-1fc3c294-aec7-474b-bc08-0f090511486e tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 343ae383-5bfd-4c70-8926-a800fcee3519] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:27.620159 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-1fc3c294-aec7-474b-bc08-0f090511486e tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:27.620602 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-1fc3c294-aec7-474b-bc08-0f090511486e tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:27.621348 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-1fc3c294-aec7-474b-bc08-0f090511486e tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:27.621929 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-1fc3c294-aec7-474b-bc08-0f090511486e tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:27.753517 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-1fc3c294-aec7-474b-bc08-0f090511486e tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c75043813844d79fd0764132dfe4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e234f713b40cd8772372c2316dd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:27.761500 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-1fc3c294-aec7-474b-bc08-0f090511486e tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519" status: 200 len: 1724 microversion: 2.1 time: 0.152382 Jul 19 15:48:27.762070 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 289/517] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:48:27 2022] GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:48:28.282591 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-72481148-cec7-4cd5-a0a4-2037a6e19b4d tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:28.283216 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-72481148-cec7-4cd5-a0a4-2037a6e19b4d tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:28.290372 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-72481148-cec7-4cd5-a0a4-2037a6e19b4d tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:28.290829 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-72481148-cec7-4cd5-a0a4-2037a6e19b4d tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:28.291588 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-72481148-cec7-4cd5-a0a4-2037a6e19b4d tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:28.292021 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-72481148-cec7-4cd5-a0a4-2037a6e19b4d tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:28.425171 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-72481148-cec7-4cd5-a0a4-2037a6e19b4d tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:28.433641 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-72481148-cec7-4cd5-a0a4-2037a6e19b4d tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:28.435179 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-72481148-cec7-4cd5-a0a4-2037a6e19b4d tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:28.436335 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-72481148-cec7-4cd5-a0a4-2037a6e19b4d tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 200 len: 1808 microversion: 2.20 time: 0.158428 Jul 19 15:48:28.436896 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 229/518] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:48:28 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 1808 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:48:28.456960 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-eb216bd6-bf53-4b21-85db-9961d7554775 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:28.457863 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-eb216bd6-bf53-4b21-85db-9961d7554775 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] [instance: 17f9fd89-e668-4d3d-8d85-e648189ba0c2] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:28.464107 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-eb216bd6-bf53-4b21-85db-9961d7554775 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:28.464555 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-eb216bd6-bf53-4b21-85db-9961d7554775 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:28.465328 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-eb216bd6-bf53-4b21-85db-9961d7554775 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:28.465765 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-eb216bd6-bf53-4b21-85db-9961d7554775 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:28.601416 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-eb216bd6-bf53-4b21-85db-9961d7554775 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae334c4d93cd4d3e94789a5985fcfa77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6827afcdf1f3481882f808dc01908a4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:28.608857 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-eb216bd6-bf53-4b21-85db-9961d7554775 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] 10.222.0.64 "GET /compute/v2.1/servers/17f9fd89-e668-4d3d-8d85-e648189ba0c2" status: 200 len: 1265 microversion: 2.1 time: 0.155881 Jul 19 15:48:28.609426 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 290/519] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:48:28 2022] GET /compute/v2.1/servers/17f9fd89-e668-4d3d-8d85-e648189ba0c2 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:48:28.778454 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-0c89dd29-af59-491f-939b-aaafd507c29e tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:28.779059 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-0c89dd29-af59-491f-939b-aaafd507c29e tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 343ae383-5bfd-4c70-8926-a800fcee3519] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:28.786047 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-0c89dd29-af59-491f-939b-aaafd507c29e tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:28.786605 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-0c89dd29-af59-491f-939b-aaafd507c29e tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:28.787635 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-0c89dd29-af59-491f-939b-aaafd507c29e tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:28.788070 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-0c89dd29-af59-491f-939b-aaafd507c29e tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:28.918749 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-0c89dd29-af59-491f-939b-aaafd507c29e tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c75043813844d79fd0764132dfe4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e234f713b40cd8772372c2316dd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:28.927148 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-0c89dd29-af59-491f-939b-aaafd507c29e tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519" status: 200 len: 1724 microversion: 2.1 time: 0.152679 Jul 19 15:48:28.927700 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 230/520] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:48:28 2022] GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:48:29.455862 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-372e74d6-88ac-4852-9315-fffb96fb62d5 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:29.456459 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-372e74d6-88ac-4852-9315-fffb96fb62d5 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:29.463113 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-372e74d6-88ac-4852-9315-fffb96fb62d5 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:29.463673 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-372e74d6-88ac-4852-9315-fffb96fb62d5 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:29.464296 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-372e74d6-88ac-4852-9315-fffb96fb62d5 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:29.464727 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-372e74d6-88ac-4852-9315-fffb96fb62d5 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:29.594414 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-372e74d6-88ac-4852-9315-fffb96fb62d5 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:29.602823 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-372e74d6-88ac-4852-9315-fffb96fb62d5 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:29.604335 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-372e74d6-88ac-4852-9315-fffb96fb62d5 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:29.605479 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-372e74d6-88ac-4852-9315-fffb96fb62d5 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 200 len: 1808 microversion: 2.20 time: 0.154179 Jul 19 15:48:29.606041 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 291/521] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:48:29 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 1808 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 15:48:29.626743 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-5ccdc959-4c72-4427-ab00-cd6061797ec5 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:29.627375 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-5ccdc959-4c72-4427-ab00-cd6061797ec5 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] [instance: 17f9fd89-e668-4d3d-8d85-e648189ba0c2] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:29.633748 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-5ccdc959-4c72-4427-ab00-cd6061797ec5 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:29.634192 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-5ccdc959-4c72-4427-ab00-cd6061797ec5 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:29.635007 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-5ccdc959-4c72-4427-ab00-cd6061797ec5 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:29.635444 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-5ccdc959-4c72-4427-ab00-cd6061797ec5 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:29.772349 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-5ccdc959-4c72-4427-ab00-cd6061797ec5 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae334c4d93cd4d3e94789a5985fcfa77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6827afcdf1f3481882f808dc01908a4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:29.779750 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-5ccdc959-4c72-4427-ab00-cd6061797ec5 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] 10.222.0.64 "GET /compute/v2.1/servers/17f9fd89-e668-4d3d-8d85-e648189ba0c2" status: 200 len: 1265 microversion: 2.1 time: 0.157577 Jul 19 15:48:29.780304 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 231/522] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:48:29 2022] GET /compute/v2.1/servers/17f9fd89-e668-4d3d-8d85-e648189ba0c2 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:48:29.944451 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-8af8592e-5521-47b4-87e4-bd1e3631ef0b tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:29.945124 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-8af8592e-5521-47b4-87e4-bd1e3631ef0b tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 343ae383-5bfd-4c70-8926-a800fcee3519] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:29.951783 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-8af8592e-5521-47b4-87e4-bd1e3631ef0b tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:29.952268 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-8af8592e-5521-47b4-87e4-bd1e3631ef0b tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:29.953102 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-8af8592e-5521-47b4-87e4-bd1e3631ef0b tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:29.954244 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-8af8592e-5521-47b4-87e4-bd1e3631ef0b tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:29.959207 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG dbcounter [-] [129520] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:48:29.964784 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [req-cc6c871d-6924-4439-a4ba-292689afae52 req-512fbe9f-5e7c-42a9-b514-5425f53caff2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17f9fd89-e668-4d3d-8d85-e648189ba0c2", "name": "network-vif-plugged", "status": "completed", "tag": "e3f80a5b-6ebe-4e28-8cb3-bd8fbe84b1e6"}]} {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:48:29.973209 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [req-cc6c871d-6924-4439-a4ba-292689afae52 req-512fbe9f-5e7c-42a9-b514-5425f53caff2 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:29.973653 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [req-cc6c871d-6924-4439-a4ba-292689afae52 req-512fbe9f-5e7c-42a9-b514-5425f53caff2 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:29.987016 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.compute.server_external_events [req-cc6c871d-6924-4439-a4ba-292689afae52 req-512fbe9f-5e7c-42a9-b514-5425f53caff2 service nova] Creating event network-vif-plugged:e3f80a5b-6ebe-4e28-8cb3-bd8fbe84b1e6 for instance 17f9fd89-e668-4d3d-8d85-e648189ba0c2 on hv-cinder-84902 Jul 19 15:48:29.991807 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [req-cc6c871d-6924-4439-a4ba-292689afae52 req-512fbe9f-5e7c-42a9-b514-5425f53caff2 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032177 Jul 19 15:48:29.992585 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 232/523] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Jul 19 15:48:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:48:30.092617 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-8af8592e-5521-47b4-87e4-bd1e3631ef0b tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c75043813844d79fd0764132dfe4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e234f713b40cd8772372c2316dd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:30.101303 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-8af8592e-5521-47b4-87e4-bd1e3631ef0b tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519" status: 200 len: 1724 microversion: 2.1 time: 0.161020 Jul 19 15:48:30.101864 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 292/524] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:48:29 2022] GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:48:30.624906 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-4875b895-a220-4249-ab23-fd8ed5dbdf30 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:30.626370 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-4875b895-a220-4249-ab23-fd8ed5dbdf30 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:30.633036 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-4875b895-a220-4249-ab23-fd8ed5dbdf30 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:30.633660 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-4875b895-a220-4249-ab23-fd8ed5dbdf30 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:30.634286 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-4875b895-a220-4249-ab23-fd8ed5dbdf30 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:30.634776 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-4875b895-a220-4249-ab23-fd8ed5dbdf30 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:30.774413 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-4875b895-a220-4249-ab23-fd8ed5dbdf30 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:30.783011 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-4875b895-a220-4249-ab23-fd8ed5dbdf30 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:30.784521 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-4875b895-a220-4249-ab23-fd8ed5dbdf30 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:30.785672 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-4875b895-a220-4249-ab23-fd8ed5dbdf30 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 200 len: 1808 microversion: 2.20 time: 0.165105 Jul 19 15:48:30.786233 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 233/525] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:48:30 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 1808 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:48:30.796408 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-74668974-bb6a-4a85-b370-2ad5c3b0766e tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:30.797075 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-74668974-bb6a-4a85-b370-2ad5c3b0766e tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] [instance: 17f9fd89-e668-4d3d-8d85-e648189ba0c2] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:30.803732 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-74668974-bb6a-4a85-b370-2ad5c3b0766e tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:30.804173 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-74668974-bb6a-4a85-b370-2ad5c3b0766e tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:30.804920 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-74668974-bb6a-4a85-b370-2ad5c3b0766e tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:30.805346 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-74668974-bb6a-4a85-b370-2ad5c3b0766e tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:30.940525 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-74668974-bb6a-4a85-b370-2ad5c3b0766e tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae334c4d93cd4d3e94789a5985fcfa77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6827afcdf1f3481882f808dc01908a4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:30.947945 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-74668974-bb6a-4a85-b370-2ad5c3b0766e tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] 10.222.0.64 "GET /compute/v2.1/servers/17f9fd89-e668-4d3d-8d85-e648189ba0c2" status: 200 len: 1265 microversion: 2.1 time: 0.155354 Jul 19 15:48:30.948505 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 293/526] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:48:30 2022] GET /compute/v2.1/servers/17f9fd89-e668-4d3d-8d85-e648189ba0c2 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:48:31.118589 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-5a04068c-c1e6-4cba-8ff2-0bf9def8e705 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:31.119193 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-5a04068c-c1e6-4cba-8ff2-0bf9def8e705 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 343ae383-5bfd-4c70-8926-a800fcee3519] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:31.125315 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-5a04068c-c1e6-4cba-8ff2-0bf9def8e705 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:31.125805 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-5a04068c-c1e6-4cba-8ff2-0bf9def8e705 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:31.126597 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-5a04068c-c1e6-4cba-8ff2-0bf9def8e705 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:31.127036 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-5a04068c-c1e6-4cba-8ff2-0bf9def8e705 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:31.259239 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-5a04068c-c1e6-4cba-8ff2-0bf9def8e705 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c75043813844d79fd0764132dfe4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e234f713b40cd8772372c2316dd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:31.267410 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-5a04068c-c1e6-4cba-8ff2-0bf9def8e705 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519" status: 200 len: 1724 microversion: 2.1 time: 0.152694 Jul 19 15:48:31.267972 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 234/527] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:48:31 2022] GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:48:31.804221 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-a7aca170-700e-4c7b-80d8-b7230cf50717 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:31.804755 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-a7aca170-700e-4c7b-80d8-b7230cf50717 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:31.811220 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-a7aca170-700e-4c7b-80d8-b7230cf50717 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:31.811658 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-a7aca170-700e-4c7b-80d8-b7230cf50717 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:31.812411 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-a7aca170-700e-4c7b-80d8-b7230cf50717 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:31.813522 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-a7aca170-700e-4c7b-80d8-b7230cf50717 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:31.943836 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-a7aca170-700e-4c7b-80d8-b7230cf50717 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:31.952200 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-a7aca170-700e-4c7b-80d8-b7230cf50717 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:31.955856 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-a7aca170-700e-4c7b-80d8-b7230cf50717 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:31.957442 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-a7aca170-700e-4c7b-80d8-b7230cf50717 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 200 len: 1808 microversion: 2.20 time: 0.157165 Jul 19 15:48:31.958022 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 294/528] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:48:31 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 1808 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 15:48:31.964782 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-f5bab724-79e0-4f87-b687-03d16e4ee878 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:31.965380 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-f5bab724-79e0-4f87-b687-03d16e4ee878 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] [instance: 17f9fd89-e668-4d3d-8d85-e648189ba0c2] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:31.967824 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG dbcounter [-] [129519] Writing DB stats nova_api:SELECT=96 {{(pid=129519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:48:31.973716 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-f5bab724-79e0-4f87-b687-03d16e4ee878 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:31.974152 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-f5bab724-79e0-4f87-b687-03d16e4ee878 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:31.974926 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-f5bab724-79e0-4f87-b687-03d16e4ee878 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:31.975351 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-f5bab724-79e0-4f87-b687-03d16e4ee878 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:32.109369 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-f5bab724-79e0-4f87-b687-03d16e4ee878 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae334c4d93cd4d3e94789a5985fcfa77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6827afcdf1f3481882f808dc01908a4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:32.117430 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-f5bab724-79e0-4f87-b687-03d16e4ee878 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] 10.222.0.64 "GET /compute/v2.1/servers/17f9fd89-e668-4d3d-8d85-e648189ba0c2" status: 200 len: 1265 microversion: 2.1 time: 0.156453 Jul 19 15:48:32.118011 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 235/529] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:48:31 2022] GET /compute/v2.1/servers/17f9fd89-e668-4d3d-8d85-e648189ba0c2 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:48:32.194499 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 15:48:32.194658 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Tue Jul 19 15:48:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 15:48:32.284315 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-e3b607d5-6837-4f59-9707-a738b0f7e15a tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:32.285002 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-e3b607d5-6837-4f59-9707-a738b0f7e15a tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 343ae383-5bfd-4c70-8926-a800fcee3519] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:32.291290 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-e3b607d5-6837-4f59-9707-a738b0f7e15a tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:32.291731 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-e3b607d5-6837-4f59-9707-a738b0f7e15a tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:32.292485 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-e3b607d5-6837-4f59-9707-a738b0f7e15a tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:32.292920 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-e3b607d5-6837-4f59-9707-a738b0f7e15a tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:32.424672 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-e3b607d5-6837-4f59-9707-a738b0f7e15a tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c75043813844d79fd0764132dfe4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e234f713b40cd8772372c2316dd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:32.432574 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-e3b607d5-6837-4f59-9707-a738b0f7e15a tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519" status: 200 len: 1724 microversion: 2.1 time: 0.152579 Jul 19 15:48:32.433140 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 295/530] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:48:32 2022] GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:48:32.974926 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-f810649f-213a-4799-bdc2-7c736839c521 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:32.975446 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-f810649f-213a-4799-bdc2-7c736839c521 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:32.982082 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-f810649f-213a-4799-bdc2-7c736839c521 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:32.982555 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-f810649f-213a-4799-bdc2-7c736839c521 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:32.983324 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-f810649f-213a-4799-bdc2-7c736839c521 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:32.983749 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-f810649f-213a-4799-bdc2-7c736839c521 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:33.122486 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-f810649f-213a-4799-bdc2-7c736839c521 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:33.131091 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-f810649f-213a-4799-bdc2-7c736839c521 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:33.132606 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-f810649f-213a-4799-bdc2-7c736839c521 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:33.133756 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-f810649f-213a-4799-bdc2-7c736839c521 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 200 len: 1808 microversion: 2.20 time: 0.162839 Jul 19 15:48:33.133970 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-5db548cd-d258-4858-8187-77533c5cdfb5 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:33.134598 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 236/531] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:48:32 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 1808 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:48:33.134710 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-5db548cd-d258-4858-8187-77533c5cdfb5 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] [instance: 17f9fd89-e668-4d3d-8d85-e648189ba0c2] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:33.141396 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-5db548cd-d258-4858-8187-77533c5cdfb5 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:33.141835 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-5db548cd-d258-4858-8187-77533c5cdfb5 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:33.142619 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-5db548cd-d258-4858-8187-77533c5cdfb5 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:33.143080 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-5db548cd-d258-4858-8187-77533c5cdfb5 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:33.278804 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-5db548cd-d258-4858-8187-77533c5cdfb5 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae334c4d93cd4d3e94789a5985fcfa77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6827afcdf1f3481882f808dc01908a4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:33.287085 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-5db548cd-d258-4858-8187-77533c5cdfb5 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] 10.222.0.64 "GET /compute/v2.1/servers/17f9fd89-e668-4d3d-8d85-e648189ba0c2" status: 200 len: 1265 microversion: 2.1 time: 0.157072 Jul 19 15:48:33.287896 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 296/532] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:48:33 2022] GET /compute/v2.1/servers/17f9fd89-e668-4d3d-8d85-e648189ba0c2 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:48:33.450553 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-b58959b0-89f3-44fc-8f46-275302452e53 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:33.451177 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-b58959b0-89f3-44fc-8f46-275302452e53 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 343ae383-5bfd-4c70-8926-a800fcee3519] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:33.457763 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-b58959b0-89f3-44fc-8f46-275302452e53 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:33.458211 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-b58959b0-89f3-44fc-8f46-275302452e53 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:33.459059 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-b58959b0-89f3-44fc-8f46-275302452e53 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:33.459486 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-b58959b0-89f3-44fc-8f46-275302452e53 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:33.586990 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-b58959b0-89f3-44fc-8f46-275302452e53 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c75043813844d79fd0764132dfe4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e234f713b40cd8772372c2316dd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:33.595628 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-b58959b0-89f3-44fc-8f46-275302452e53 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519" status: 200 len: 1724 microversion: 2.1 time: 0.148975 Jul 19 15:48:33.596184 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 237/533] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:48:33 2022] GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519 => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:48:34.152232 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-c3e2e441-d957-4c9e-8033-c9688d985a39 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:34.152830 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-c3e2e441-d957-4c9e-8033-c9688d985a39 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:34.160449 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-c3e2e441-d957-4c9e-8033-c9688d985a39 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:34.160891 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-c3e2e441-d957-4c9e-8033-c9688d985a39 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:34.161642 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-c3e2e441-d957-4c9e-8033-c9688d985a39 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:34.162075 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-c3e2e441-d957-4c9e-8033-c9688d985a39 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:34.302014 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-c3e2e441-d957-4c9e-8033-c9688d985a39 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:34.304884 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-7beca875-dcc6-453a-95fa-c4144328f1ba tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:34.305677 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-7beca875-dcc6-453a-95fa-c4144328f1ba tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] [instance: 17f9fd89-e668-4d3d-8d85-e648189ba0c2] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:34.311903 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-c3e2e441-d957-4c9e-8033-c9688d985a39 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:34.313618 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-7beca875-dcc6-453a-95fa-c4144328f1ba tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:34.314858 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-7beca875-dcc6-453a-95fa-c4144328f1ba tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:34.314953 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-c3e2e441-d957-4c9e-8033-c9688d985a39 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:34.315044 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-7beca875-dcc6-453a-95fa-c4144328f1ba tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:34.315385 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-7beca875-dcc6-453a-95fa-c4144328f1ba tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:34.316105 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-c3e2e441-d957-4c9e-8033-c9688d985a39 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 200 len: 1808 microversion: 2.20 time: 0.167664 Jul 19 15:48:34.317055 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 297/534] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:48:34 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 1808 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:48:34.460800 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-7beca875-dcc6-453a-95fa-c4144328f1ba tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae334c4d93cd4d3e94789a5985fcfa77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6827afcdf1f3481882f808dc01908a4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:34.470562 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-7beca875-dcc6-453a-95fa-c4144328f1ba tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] 10.222.0.64 "GET /compute/v2.1/servers/17f9fd89-e668-4d3d-8d85-e648189ba0c2" status: 200 len: 1265 microversion: 2.1 time: 0.169908 Jul 19 15:48:34.471447 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 238/535] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:48:34 2022] GET /compute/v2.1/servers/17f9fd89-e668-4d3d-8d85-e648189ba0c2 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:48:34.613366 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-721349b4-9755-4d98-b1dc-06db5b30ffb6 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:34.614030 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-721349b4-9755-4d98-b1dc-06db5b30ffb6 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 343ae383-5bfd-4c70-8926-a800fcee3519] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:34.620192 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-721349b4-9755-4d98-b1dc-06db5b30ffb6 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:34.620637 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-721349b4-9755-4d98-b1dc-06db5b30ffb6 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:34.621398 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-721349b4-9755-4d98-b1dc-06db5b30ffb6 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:34.621833 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-721349b4-9755-4d98-b1dc-06db5b30ffb6 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:34.755877 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-721349b4-9755-4d98-b1dc-06db5b30ffb6 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c75043813844d79fd0764132dfe4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e234f713b40cd8772372c2316dd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:34.763920 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-721349b4-9755-4d98-b1dc-06db5b30ffb6 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519" status: 200 len: 1724 microversion: 2.1 time: 0.155097 Jul 19 15:48:34.764494 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 298/536] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:48:34 2022] GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:48:35.336199 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-2b6214b4-1f7d-4d88-882c-ab2f5764c79f tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:35.336787 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-2b6214b4-1f7d-4d88-882c-ab2f5764c79f tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:35.343461 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-2b6214b4-1f7d-4d88-882c-ab2f5764c79f tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:35.344420 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-2b6214b4-1f7d-4d88-882c-ab2f5764c79f tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:35.345350 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-2b6214b4-1f7d-4d88-882c-ab2f5764c79f tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:35.345785 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-2b6214b4-1f7d-4d88-882c-ab2f5764c79f tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:35.479506 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-2b6214b4-1f7d-4d88-882c-ab2f5764c79f tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:35.482918 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG dbcounter [-] [129519] Writing DB stats nova_cell1:SELECT=100 {{(pid=129519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:48:35.488312 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-3309e97d-5849-4b9f-a0bf-412e7d047e28 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:35.489009 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-3309e97d-5849-4b9f-a0bf-412e7d047e28 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] [instance: 17f9fd89-e668-4d3d-8d85-e648189ba0c2] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:35.489723 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-2b6214b4-1f7d-4d88-882c-ab2f5764c79f tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:35.491258 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-2b6214b4-1f7d-4d88-882c-ab2f5764c79f tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:35.492417 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-2b6214b4-1f7d-4d88-882c-ab2f5764c79f tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 200 len: 1795 microversion: 2.20 time: 0.161475 Jul 19 15:48:35.492967 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 239/537] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:48:35 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 1795 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:48:35.495976 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-3309e97d-5849-4b9f-a0bf-412e7d047e28 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:35.496422 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-3309e97d-5849-4b9f-a0bf-412e7d047e28 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:35.497182 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-3309e97d-5849-4b9f-a0bf-412e7d047e28 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:35.497613 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-3309e97d-5849-4b9f-a0bf-412e7d047e28 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:35.626953 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-3309e97d-5849-4b9f-a0bf-412e7d047e28 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae334c4d93cd4d3e94789a5985fcfa77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6827afcdf1f3481882f808dc01908a4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:35.634344 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-3309e97d-5849-4b9f-a0bf-412e7d047e28 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] 10.222.0.64 "GET /compute/v2.1/servers/17f9fd89-e668-4d3d-8d85-e648189ba0c2" status: 200 len: 1451 microversion: 2.1 time: 0.150777 Jul 19 15:48:35.635004 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 299/538] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:48:35 2022] GET /compute/v2.1/servers/17f9fd89-e668-4d3d-8d85-e648189ba0c2 => generated 1451 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:48:35.651719 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-5b35b73a-0e18-4245-913a-e3cdba822b28 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:35.652321 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-5b35b73a-0e18-4245-913a-e3cdba822b28 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] [instance: 17f9fd89-e668-4d3d-8d85-e648189ba0c2] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:35.659022 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-5b35b73a-0e18-4245-913a-e3cdba822b28 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:35.659495 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-5b35b73a-0e18-4245-913a-e3cdba822b28 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:35.660261 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-5b35b73a-0e18-4245-913a-e3cdba822b28 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:35.660694 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-5b35b73a-0e18-4245-913a-e3cdba822b28 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:35.780904 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-bc3c471e-3e30-4620-9eef-588490729b51 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:35.781814 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-bc3c471e-3e30-4620-9eef-588490729b51 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 343ae383-5bfd-4c70-8926-a800fcee3519] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:35.788237 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-bc3c471e-3e30-4620-9eef-588490729b51 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:35.788691 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-bc3c471e-3e30-4620-9eef-588490729b51 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:35.789463 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-bc3c471e-3e30-4620-9eef-588490729b51 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:35.789900 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-bc3c471e-3e30-4620-9eef-588490729b51 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:35.791290 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-5b35b73a-0e18-4245-913a-e3cdba822b28 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae334c4d93cd4d3e94789a5985fcfa77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6827afcdf1f3481882f808dc01908a4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:35.799797 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-5b35b73a-0e18-4245-913a-e3cdba822b28 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] 10.222.0.64 "GET /compute/v2.1/servers/17f9fd89-e668-4d3d-8d85-e648189ba0c2" status: 200 len: 1451 microversion: 2.1 time: 0.152045 Jul 19 15:48:35.800616 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 240/539] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:48:35 2022] GET /compute/v2.1/servers/17f9fd89-e668-4d3d-8d85-e648189ba0c2 => generated 1451 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:48:35.928083 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-bc3c471e-3e30-4620-9eef-588490729b51 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c75043813844d79fd0764132dfe4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e234f713b40cd8772372c2316dd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:35.936093 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-bc3c471e-3e30-4620-9eef-588490729b51 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519" status: 200 len: 1701 microversion: 2.1 time: 0.159045 Jul 19 15:48:35.936664 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 300/540] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:48:35 2022] GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519 => generated 1701 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:48:35.952855 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-6dcec6eb-432b-4eb2-9037-7122ff79fe9a tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:48:35.959724 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-6dcec6eb-432b-4eb2-9037-7122ff79fe9a tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:35.960178 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-6dcec6eb-432b-4eb2-9037-7122ff79fe9a tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:36.021401 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-6dcec6eb-432b-4eb2-9037-7122ff79fe9a tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 343ae383-5bfd-4c70-8926-a800fcee3519] Going to try to start instance {{(pid=129519) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 19 15:48:36.067472 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-6dcec6eb-432b-4eb2-9037-7122ff79fe9a tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "POST /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519/action" status: 202 len: 0 microversion: 2.1 time: 0.118060 Jul 19 15:48:36.068077 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 241/541] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Jul 19 15:48:35 2022] POST /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519/action => generated 0 bytes in 120 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 15:48:36.075956 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-49f8cb21-9fa8-4d6d-8f70-e5b8f138caf1 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:36.076651 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-49f8cb21-9fa8-4d6d-8f70-e5b8f138caf1 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 343ae383-5bfd-4c70-8926-a800fcee3519] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:36.082881 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-49f8cb21-9fa8-4d6d-8f70-e5b8f138caf1 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:36.083337 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-49f8cb21-9fa8-4d6d-8f70-e5b8f138caf1 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:36.084109 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-49f8cb21-9fa8-4d6d-8f70-e5b8f138caf1 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:36.084545 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-49f8cb21-9fa8-4d6d-8f70-e5b8f138caf1 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:36.295923 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-49f8cb21-9fa8-4d6d-8f70-e5b8f138caf1 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c75043813844d79fd0764132dfe4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e234f713b40cd8772372c2316dd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:36.305294 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-49f8cb21-9fa8-4d6d-8f70-e5b8f138caf1 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519" status: 200 len: 1710 microversion: 2.1 time: 0.233116 Jul 19 15:48:36.305862 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 301/542] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:48:36 2022] GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519 => generated 1710 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:48:37.325035 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-c8d44d8f-615f-4e19-bbb0-37603a08cdea tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:37.325784 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-c8d44d8f-615f-4e19-bbb0-37603a08cdea tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 343ae383-5bfd-4c70-8926-a800fcee3519] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:37.332736 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-c8d44d8f-615f-4e19-bbb0-37603a08cdea tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:37.333189 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-c8d44d8f-615f-4e19-bbb0-37603a08cdea tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:37.333946 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-c8d44d8f-615f-4e19-bbb0-37603a08cdea tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:37.334447 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-c8d44d8f-615f-4e19-bbb0-37603a08cdea tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:37.478164 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-c8d44d8f-615f-4e19-bbb0-37603a08cdea tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c75043813844d79fd0764132dfe4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e234f713b40cd8772372c2316dd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:37.487271 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-c8d44d8f-615f-4e19-bbb0-37603a08cdea tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519" status: 200 len: 1710 microversion: 2.1 time: 0.166983 Jul 19 15:48:37.487988 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 242/543] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:48:37 2022] GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519 => generated 1710 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:48:37.859021 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [req-5b90c12f-0e74-4170-abaf-b07f0481de33 req-c7280aa5-1ff5-498f-b5d4-a15c7cc96d17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17f9fd89-e668-4d3d-8d85-e648189ba0c2", "tag": "e3f80a5b-6ebe-4e28-8cb3-bd8fbe84b1e6"}]} {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:48:37.868216 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [req-5b90c12f-0e74-4170-abaf-b07f0481de33 req-c7280aa5-1ff5-498f-b5d4-a15c7cc96d17 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:37.868654 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [req-5b90c12f-0e74-4170-abaf-b07f0481de33 req-c7280aa5-1ff5-498f-b5d4-a15c7cc96d17 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:37.882034 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.compute.server_external_events [req-5b90c12f-0e74-4170-abaf-b07f0481de33 req-c7280aa5-1ff5-498f-b5d4-a15c7cc96d17 service nova] Creating event network-changed:e3f80a5b-6ebe-4e28-8cb3-bd8fbe84b1e6 for instance 17f9fd89-e668-4d3d-8d85-e648189ba0c2 on hv-cinder-84902 Jul 19 15:48:37.886938 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [req-5b90c12f-0e74-4170-abaf-b07f0481de33 req-c7280aa5-1ff5-498f-b5d4-a15c7cc96d17 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031469 Jul 19 15:48:37.887518 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 302/544] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Jul 19 15:48:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:48:38.505320 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-bdd5d6ba-d0be-474c-b6a7-a1a77f06ea5b tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:38.505866 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-bdd5d6ba-d0be-474c-b6a7-a1a77f06ea5b tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 343ae383-5bfd-4c70-8926-a800fcee3519] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:38.512992 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-bdd5d6ba-d0be-474c-b6a7-a1a77f06ea5b tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:38.513431 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-bdd5d6ba-d0be-474c-b6a7-a1a77f06ea5b tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:38.514182 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-bdd5d6ba-d0be-474c-b6a7-a1a77f06ea5b tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:38.514633 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-bdd5d6ba-d0be-474c-b6a7-a1a77f06ea5b tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:38.644048 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-bdd5d6ba-d0be-474c-b6a7-a1a77f06ea5b tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c75043813844d79fd0764132dfe4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e234f713b40cd8772372c2316dd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:38.652177 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-bdd5d6ba-d0be-474c-b6a7-a1a77f06ea5b tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519" status: 200 len: 1710 microversion: 2.1 time: 0.150714 Jul 19 15:48:38.652749 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 243/545] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:48:38 2022] GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519 => generated 1710 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:48:39.671284 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-f0f82b89-baf1-40dd-93b2-a126f48c28b7 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:39.672650 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-f0f82b89-baf1-40dd-93b2-a126f48c28b7 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 343ae383-5bfd-4c70-8926-a800fcee3519] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:39.679366 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-f0f82b89-baf1-40dd-93b2-a126f48c28b7 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:39.679921 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-f0f82b89-baf1-40dd-93b2-a126f48c28b7 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:39.680805 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-f0f82b89-baf1-40dd-93b2-a126f48c28b7 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:39.681322 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-f0f82b89-baf1-40dd-93b2-a126f48c28b7 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:39.814709 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-f0f82b89-baf1-40dd-93b2-a126f48c28b7 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c75043813844d79fd0764132dfe4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e234f713b40cd8772372c2316dd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:39.822693 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-f0f82b89-baf1-40dd-93b2-a126f48c28b7 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519" status: 200 len: 1710 microversion: 2.1 time: 0.156419 Jul 19 15:48:39.823379 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 303/546] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:48:39 2022] GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519 => generated 1710 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:48:40.839946 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-1b86fb61-f44c-4424-991d-64ae1403e8e8 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:40.840539 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-1b86fb61-f44c-4424-991d-64ae1403e8e8 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 343ae383-5bfd-4c70-8926-a800fcee3519] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:40.847504 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-1b86fb61-f44c-4424-991d-64ae1403e8e8 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:40.847951 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-1b86fb61-f44c-4424-991d-64ae1403e8e8 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:40.848714 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-1b86fb61-f44c-4424-991d-64ae1403e8e8 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:40.849150 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-1b86fb61-f44c-4424-991d-64ae1403e8e8 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:40.976812 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-1b86fb61-f44c-4424-991d-64ae1403e8e8 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c75043813844d79fd0764132dfe4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e234f713b40cd8772372c2316dd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:40.985451 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-1b86fb61-f44c-4424-991d-64ae1403e8e8 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519" status: 200 len: 1710 microversion: 2.1 time: 0.149368 Jul 19 15:48:40.986011 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 244/547] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:48:40 2022] GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519 => generated 1710 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:48:42.003140 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-efafcfca-36e3-401c-aca1-4c99a8f27098 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:42.003695 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-efafcfca-36e3-401c-aca1-4c99a8f27098 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 343ae383-5bfd-4c70-8926-a800fcee3519] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:42.006181 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG dbcounter [-] [129520] Writing DB stats nova_api:SELECT=88 {{(pid=129520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:48:42.011622 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-efafcfca-36e3-401c-aca1-4c99a8f27098 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:42.012072 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-efafcfca-36e3-401c-aca1-4c99a8f27098 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:42.012834 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-efafcfca-36e3-401c-aca1-4c99a8f27098 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:42.013270 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-efafcfca-36e3-401c-aca1-4c99a8f27098 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:42.144781 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-efafcfca-36e3-401c-aca1-4c99a8f27098 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c75043813844d79fd0764132dfe4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e234f713b40cd8772372c2316dd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:42.152696 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-efafcfca-36e3-401c-aca1-4c99a8f27098 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519" status: 200 len: 1714 microversion: 2.1 time: 0.153862 Jul 19 15:48:42.153342 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 304/548] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:48:41 2022] GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519 => generated 1714 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:48:42.439643 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-016945a7-53c1-4c06-a651-d1a93539bd4c tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:42.440150 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-016945a7-53c1-4c06-a651-d1a93539bd4c tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] [instance: 4157bc30-5973-4e95-a9de-fa467709484e] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:42.446739 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-016945a7-53c1-4c06-a651-d1a93539bd4c tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:42.447179 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-016945a7-53c1-4c06-a651-d1a93539bd4c tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:42.447926 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-016945a7-53c1-4c06-a651-d1a93539bd4c tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:42.448352 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-016945a7-53c1-4c06-a651-d1a93539bd4c tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:42.568683 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.objects.instance [None req-016945a7-53c1-4c06-a651-d1a93539bd4c tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lazy-loading 'services' on Instance uuid 4157bc30-5973-4e95-a9de-fa467709484e {{(pid=129519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 15:48:42.683012 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-016945a7-53c1-4c06-a651-d1a93539bd4c tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] 10.222.0.64 "DELETE /compute/v2.1/servers/4157bc30-5973-4e95-a9de-fa467709484e/os-volume_attachments/0eaf7f24-3c09-4af8-bb04-b73111979115" status: 202 len: 0 microversion: 2.1 time: 0.247391 Jul 19 15:48:42.683810 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 245/549] 10.222.0.64 () {58 vars in 1415 bytes} [Tue Jul 19 15:48:42 2022] DELETE /compute/v2.1/servers/4157bc30-5973-4e95-a9de-fa467709484e/os-volume_attachments/0eaf7f24-3c09-4af8-bb04-b73111979115 => generated 0 bytes in 249 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 15:48:44.863515 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-7c0da3ef-6068-4723-bfe2-920afae64925 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:44.864338 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-7c0da3ef-6068-4723-bfe2-920afae64925 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] [instance: 4157bc30-5973-4e95-a9de-fa467709484e] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:44.871384 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-7c0da3ef-6068-4723-bfe2-920afae64925 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:44.871836 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-7c0da3ef-6068-4723-bfe2-920afae64925 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:44.872643 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-7c0da3ef-6068-4723-bfe2-920afae64925 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:44.873086 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-7c0da3ef-6068-4723-bfe2-920afae64925 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:44.901142 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-7c0da3ef-6068-4723-bfe2-920afae64925 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] [instance: 4157bc30-5973-4e95-a9de-fa467709484e] Going to try to terminate instance {{(pid=129520) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 15:48:44.986726 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-7c0da3ef-6068-4723-bfe2-920afae64925 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] 10.222.0.64 "DELETE /compute/v2.1/servers/4157bc30-5973-4e95-a9de-fa467709484e" status: 204 len: 0 microversion: 2.1 time: 0.127361 Jul 19 15:48:44.987297 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 305/550] 10.222.0.64 () {58 vars in 1238 bytes} [Tue Jul 19 15:48:44 2022] DELETE /compute/v2.1/servers/4157bc30-5973-4e95-a9de-fa467709484e => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 15:48:44.997904 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-45979b6f-fe53-4e77-8c10-2b253de0d168 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:44.999065 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-45979b6f-fe53-4e77-8c10-2b253de0d168 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] [instance: 4157bc30-5973-4e95-a9de-fa467709484e] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:45.006462 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-45979b6f-fe53-4e77-8c10-2b253de0d168 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:45.007100 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-45979b6f-fe53-4e77-8c10-2b253de0d168 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:45.007920 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-45979b6f-fe53-4e77-8c10-2b253de0d168 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:45.008511 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-45979b6f-fe53-4e77-8c10-2b253de0d168 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:45.173202 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-45979b6f-fe53-4e77-8c10-2b253de0d168 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf2b338eac47f6bcf20a48770b2e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41bf5203b925421b9dd2ccc5b7d40ad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:45.184551 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-45979b6f-fe53-4e77-8c10-2b253de0d168 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] 10.222.0.64 "GET /compute/v2.1/servers/4157bc30-5973-4e95-a9de-fa467709484e" status: 200 len: 1512 microversion: 2.1 time: 0.191633 Jul 19 15:48:45.185182 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 246/551] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:48:44 2022] GET /compute/v2.1/servers/4157bc30-5973-4e95-a9de-fa467709484e => generated 1512 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:48:46.205731 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-8c83f4c5-3261-4d6d-9b4e-63cf1649a8bc tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:46.206474 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-8c83f4c5-3261-4d6d-9b4e-63cf1649a8bc tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] [instance: 4157bc30-5973-4e95-a9de-fa467709484e] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:46.212930 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-8c83f4c5-3261-4d6d-9b4e-63cf1649a8bc tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:46.213377 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-8c83f4c5-3261-4d6d-9b4e-63cf1649a8bc tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:46.214144 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-8c83f4c5-3261-4d6d-9b4e-63cf1649a8bc tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:46.214607 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-8c83f4c5-3261-4d6d-9b4e-63cf1649a8bc tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:46.347973 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-8c83f4c5-3261-4d6d-9b4e-63cf1649a8bc tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf2b338eac47f6bcf20a48770b2e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41bf5203b925421b9dd2ccc5b7d40ad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:46.355548 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-8c83f4c5-3261-4d6d-9b4e-63cf1649a8bc tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] 10.222.0.64 "GET /compute/v2.1/servers/4157bc30-5973-4e95-a9de-fa467709484e" status: 200 len: 1512 microversion: 2.1 time: 0.154250 Jul 19 15:48:46.356117 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 306/552] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:48:46 2022] GET /compute/v2.1/servers/4157bc30-5973-4e95-a9de-fa467709484e => generated 1512 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:48:47.373176 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-3afe3f3b-9e01-4406-908f-16d93e0f8328 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:47.373903 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-3afe3f3b-9e01-4406-908f-16d93e0f8328 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] [instance: 4157bc30-5973-4e95-a9de-fa467709484e] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:47.381386 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-3afe3f3b-9e01-4406-908f-16d93e0f8328 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:47.381837 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-3afe3f3b-9e01-4406-908f-16d93e0f8328 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:47.382872 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-3afe3f3b-9e01-4406-908f-16d93e0f8328 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:47.383309 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-3afe3f3b-9e01-4406-908f-16d93e0f8328 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:47.595785 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-3afe3f3b-9e01-4406-908f-16d93e0f8328 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf2b338eac47f6bcf20a48770b2e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41bf5203b925421b9dd2ccc5b7d40ad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:47.603545 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-3afe3f3b-9e01-4406-908f-16d93e0f8328 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] 10.222.0.64 "GET /compute/v2.1/servers/4157bc30-5973-4e95-a9de-fa467709484e" status: 200 len: 1512 microversion: 2.1 time: 0.234201 Jul 19 15:48:47.611871 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 247/553] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:48:47 2022] GET /compute/v2.1/servers/4157bc30-5973-4e95-a9de-fa467709484e => generated 1512 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:48:47.848352 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [req-1a9ffab2-f1ec-489c-89b6-cc18c4225505 req-9cc17dd8-724d-4b05-89cb-d240bdc5f1cd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4157bc30-5973-4e95-a9de-fa467709484e", "name": "network-vif-deleted", "tag": "8369d370-1c69-44be-9a5b-cbfe9b7cb0f6"}]} {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:48:47.856963 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [req-1a9ffab2-f1ec-489c-89b6-cc18c4225505 req-9cc17dd8-724d-4b05-89cb-d240bdc5f1cd service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:47.857408 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [req-1a9ffab2-f1ec-489c-89b6-cc18c4225505 req-9cc17dd8-724d-4b05-89cb-d240bdc5f1cd service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:47.869479 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.compute.server_external_events [req-1a9ffab2-f1ec-489c-89b6-cc18c4225505 req-9cc17dd8-724d-4b05-89cb-d240bdc5f1cd service nova] Creating event network-vif-deleted:8369d370-1c69-44be-9a5b-cbfe9b7cb0f6 for instance 4157bc30-5973-4e95-a9de-fa467709484e on hv-cinder-84902 Jul 19 15:48:47.875410 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [req-1a9ffab2-f1ec-489c-89b6-cc18c4225505 req-9cc17dd8-724d-4b05-89cb-d240bdc5f1cd service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030837 Jul 19 15:48:47.876023 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 307/554] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Jul 19 15:48:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 15:48:48.622834 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-a4f75735-7891-4d08-b70d-e9dde7bbeedc tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:48.623453 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-a4f75735-7891-4d08-b70d-e9dde7bbeedc tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] [instance: 4157bc30-5973-4e95-a9de-fa467709484e] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:48.630682 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-a4f75735-7891-4d08-b70d-e9dde7bbeedc tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:48.631128 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-a4f75735-7891-4d08-b70d-e9dde7bbeedc tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:48.631891 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-a4f75735-7891-4d08-b70d-e9dde7bbeedc tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:48.632331 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-a4f75735-7891-4d08-b70d-e9dde7bbeedc tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:48.645571 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.wsgi [None req-a4f75735-7891-4d08-b70d-e9dde7bbeedc tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] HTTP exception thrown: Instance 4157bc30-5973-4e95-a9de-fa467709484e could not be found. Jul 19 15:48:48.647229 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-a4f75735-7891-4d08-b70d-e9dde7bbeedc tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Request method failure captured: Jul 19 15:48:48.647229 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: request: GET /compute/v2.1/servers/4157bc30-5973-4e95-a9de-fa467709484e HTTP/1.1 Jul 19 15:48:48.647229 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Accept: application/json Jul 19 15:48:48.647229 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Accept-Encoding: identity Jul 19 15:48:48.647229 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Connection: close Jul 19 15:48:48.647229 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Content-Length: 0 Jul 19 15:48:48.647229 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Content-Type: application/json Jul 19 15:48:48.647229 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Host: 10.222.0.64 Jul 19 15:48:48.647229 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Openstack-System-Scope: None Jul 19 15:48:48.647229 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: User-Agent: python-urllib3/1.26.9 Jul 19 15:48:48.647229 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Auth-Token: gAAAAABi1tISMpdp1gU_P4TI6CuSIDdDyNIrbbeKvH082I6JbOdv-3sRqvca4MS9VZPjvZp3151yiWkhyJS3GZlYvgakWR9klSLWjRMC8kWXugvSbd1ohxG0pV3xa1FyLl5OT-3_9imYA01Tkh0kAzAWXK69PJ5RBWF6hst67GQpLEYYymdKrxA Jul 19 15:48:48.647229 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Domain-Id: None Jul 19 15:48:48.647229 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Domain-Name: None Jul 19 15:48:48.647229 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Identity-Status: Confirmed Jul 19 15:48:48.647229 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Is-Admin-Project: True Jul 19 15:48:48.647229 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Domain-Id: default Jul 19 15:48:48.647229 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Domain-Name: Default Jul 19 15:48:48.647229 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Id: 41bf5203b925421b9dd2ccc5b7d40ad8 Jul 19 15:48:48.647229 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Name: tempest-VolumesSnapshotTestJSON-560979741 Jul 19 15:48:48.647229 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Role: member,reader Jul 19 15:48:48.647229 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Roles: member,reader Jul 19 15:48:48.648595 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_41bf5203b925421b9dd2ccc5b7d40ad8", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/41bf5203b925421b9dd2ccc5b7d40ad8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/41bf5203b925421b9dd2ccc5b7d40ad8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/41bf5203b925421b9dd2ccc5b7d40ad8"}]}] Jul 19 15:48:48.648595 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Tenant: tempest-VolumesSnapshotTestJSON-560979741 Jul 19 15:48:48.648595 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Tenant-Id: 41bf5203b925421b9dd2ccc5b7d40ad8 Jul 19 15:48:48.648595 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-560979741 Jul 19 15:48:48.648595 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User: tempest-VolumesSnapshotTestJSON-560979741-project Jul 19 15:48:48.648595 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Domain-Id: default Jul 19 15:48:48.648595 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Domain-Name: Default Jul 19 15:48:48.648595 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Id: 86bf2b338eac47f6bcf20a48770b2e01 Jul 19 15:48:48.648595 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Name: tempest-VolumesSnapshotTestJSON-560979741-project Jul 19 15:48:48.648595 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: method: > Jul 19 15:48:48.648595 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: exception: Instance 4157bc30-5973-4e95-a9de-fa467709484e could not be found. Jul 19 15:48:48.648595 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: action_args: {'id': '4157bc30-5973-4e95-a9de-fa467709484e'} Jul 19 15:48:48.649395 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:48:48.649395 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:48:48.649395 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 15:48:48.649395 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 15:48:48.649395 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 15:48:48.649395 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 15:48:48.649395 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 15:48:48.649395 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 15:48:48.649395 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 15:48:48.649395 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 15:48:48.649395 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4157bc30-5973-4e95-a9de-fa467709484e could not be found. Jul 19 15:48:48.649395 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:48:48.649395 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:48:48.649395 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:48:48.649395 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:48:48.649395 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:48:48.649395 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:48:48.649395 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:48:48.649395 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:48:48.649395 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:48:48.650877 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:48:48.650877 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 15:48:48.650877 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 15:48:48.650877 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 15:48:48.650877 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 15:48:48.650877 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 15:48:48.650877 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 15:48:48.650877 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4157bc30-5973-4e95-a9de-fa467709484e could not be found. Jul 19 15:48:48.650877 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:48:48.650877 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:48:48.650877 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:48:48.650877 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:48:48.650877 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:48:48.650877 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:48:48.650877 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:48:48.650877 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:48:48.650877 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4157bc30-5973-4e95-a9de-fa467709484e could not be found. Jul 19 15:48:48.650877 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:48:48.652188 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-a4f75735-7891-4d08-b70d-e9dde7bbeedc tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Returning 404 to user: Instance 4157bc30-5973-4e95-a9de-fa467709484e could not be found. {{(pid=129519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:48:48.652188 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-a4f75735-7891-4d08-b70d-e9dde7bbeedc tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] 10.222.0.64 "GET /compute/v2.1/servers/4157bc30-5973-4e95-a9de-fa467709484e" status: 404 len: 111 microversion: 2.1 time: 0.030815 Jul 19 15:48:48.652188 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 248/555] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:48:48 2022] GET /compute/v2.1/servers/4157bc30-5973-4e95-a9de-fa467709484e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 15:48:57.486090 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-82bdee15-1110-4593-82ac-f5a02366aa01 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1723143408", "imageRef": "15012099-fe38-45ac-bd33-d884a5ba65f2", "flavorRef": "452", "networks": [{"uuid": "ff064e7f-b96b-4a93-a399-a8dfccadf354"}]}} {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:48:57.537398 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.network.neutron [None req-82bdee15-1110-4593-82ac-f5a02366aa01 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] validate_networks() for [('ff064e7f-b96b-4a93-a399-a8dfccadf354', None, None, None, None, None)] {{(pid=129520) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 15:48:57.862586 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG dbcounter [-] [129520] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:48:57.880920 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.virt.hardware [None req-82bdee15-1110-4593-82ac-f5a02366aa01 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Flavor limits 0:0:0 {{(pid=129520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 15:48:57.881342 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.virt.hardware [None req-82bdee15-1110-4593-82ac-f5a02366aa01 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Image limits 0:0:0 {{(pid=129520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 15:48:57.881814 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.virt.hardware [None req-82bdee15-1110-4593-82ac-f5a02366aa01 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Flavor pref 0:0:0 {{(pid=129520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 15:48:57.882221 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.virt.hardware [None req-82bdee15-1110-4593-82ac-f5a02366aa01 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Image pref 0:0:0 {{(pid=129520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 15:48:57.882683 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.virt.hardware [None req-82bdee15-1110-4593-82ac-f5a02366aa01 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 15:48:57.892400 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-82bdee15-1110-4593-82ac-f5a02366aa01 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:57.892844 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-82bdee15-1110-4593-82ac-f5a02366aa01 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:57.893638 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-82bdee15-1110-4593-82ac-f5a02366aa01 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:57.894074 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-82bdee15-1110-4593-82ac-f5a02366aa01 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:57.911027 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.quota [None req-82bdee15-1110-4593-82ac-f5a02366aa01 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Getting quotas for project 41bf5203b925421b9dd2ccc5b7d40ad8. Resources: {'ram', 'instances', 'cores'} {{(pid=129520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 15:48:57.915289 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.quota [None req-82bdee15-1110-4593-82ac-f5a02366aa01 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Getting quotas for user 86bf2b338eac47f6bcf20a48770b2e01 and project 41bf5203b925421b9dd2ccc5b7d40ad8. Resources: {'ram', 'instances', 'cores'} {{(pid=129520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 15:48:57.927186 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-82bdee15-1110-4593-82ac-f5a02366aa01 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Going to run 1 instances... {{(pid=129520) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 15:48:57.929565 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-82bdee15-1110-4593-82ac-f5a02366aa01 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] [instance: 672d60bf-f3f3-41af-80a8-3843b33aad78] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='15012099-fe38-45ac-bd33-d884a5ba65f2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 15:48:57.973700 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-82bdee15-1110-4593-82ac-f5a02366aa01 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.492346 Jul 19 15:48:57.974709 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 308/556] 10.222.0.64 () {60 vars in 1146 bytes} [Tue Jul 19 15:48:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 494 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 15:48:57.985325 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-9b0803eb-ca25-40c5-bd87-d24baf2aba27 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:57.985927 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-9b0803eb-ca25-40c5-bd87-d24baf2aba27 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] [instance: 672d60bf-f3f3-41af-80a8-3843b33aad78] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:58.040820 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-9b0803eb-ca25-40c5-bd87-d24baf2aba27 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf2b338eac47f6bcf20a48770b2e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41bf5203b925421b9dd2ccc5b7d40ad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:58.047842 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-9b0803eb-ca25-40c5-bd87-d24baf2aba27 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] 10.222.0.64 "GET /compute/v2.1/servers/672d60bf-f3f3-41af-80a8-3843b33aad78" status: 200 len: 1219 microversion: 2.1 time: 0.067137 Jul 19 15:48:58.048404 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 249/557] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:48:57 2022] GET /compute/v2.1/servers/672d60bf-f3f3-41af-80a8-3843b33aad78 => generated 1219 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:48:59.065183 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-ba628951-874e-4386-824f-9b2b03f041b4 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:48:59.065824 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-ba628951-874e-4386-824f-9b2b03f041b4 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] [instance: 672d60bf-f3f3-41af-80a8-3843b33aad78] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:48:59.075961 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-ba628951-874e-4386-824f-9b2b03f041b4 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:59.076548 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-ba628951-874e-4386-824f-9b2b03f041b4 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:59.077448 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-ba628951-874e-4386-824f-9b2b03f041b4 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:48:59.078566 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-ba628951-874e-4386-824f-9b2b03f041b4 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:48:59.143591 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-ba628951-874e-4386-824f-9b2b03f041b4 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf2b338eac47f6bcf20a48770b2e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41bf5203b925421b9dd2ccc5b7d40ad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:48:59.150982 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-ba628951-874e-4386-824f-9b2b03f041b4 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] 10.222.0.64 "GET /compute/v2.1/servers/672d60bf-f3f3-41af-80a8-3843b33aad78" status: 200 len: 1277 microversion: 2.1 time: 0.089939 Jul 19 15:48:59.151652 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 309/558] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:48:59 2022] GET /compute/v2.1/servers/672d60bf-f3f3-41af-80a8-3843b33aad78 => generated 1277 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:49:00.169245 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-c0152309-346f-4233-8e3c-baa0b7758bea tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:00.169906 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-c0152309-346f-4233-8e3c-baa0b7758bea tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] [instance: 672d60bf-f3f3-41af-80a8-3843b33aad78] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:00.172614 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG dbcounter [-] [129519] Writing DB stats nova_cell1:SELECT=57,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=129519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:49:00.179577 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-c0152309-346f-4233-8e3c-baa0b7758bea tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:00.180117 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-c0152309-346f-4233-8e3c-baa0b7758bea tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:00.180934 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-c0152309-346f-4233-8e3c-baa0b7758bea tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:00.181466 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-c0152309-346f-4233-8e3c-baa0b7758bea tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:00.276079 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [req-d4761fa4-5bc4-4289-bed0-a09f9283ab65 req-3a8e51da-2afb-41d0-9215-e67f49393db9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "672d60bf-f3f3-41af-80a8-3843b33aad78", "tag": "90fe63af-3f5b-4170-8459-f2ece9a2abde"}]} {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:49:00.294474 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [req-d4761fa4-5bc4-4289-bed0-a09f9283ab65 req-3a8e51da-2afb-41d0-9215-e67f49393db9 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:00.304024 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [req-d4761fa4-5bc4-4289-bed0-a09f9283ab65 req-3a8e51da-2afb-41d0-9215-e67f49393db9 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:00.318672 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.compute.server_external_events [req-d4761fa4-5bc4-4289-bed0-a09f9283ab65 req-3a8e51da-2afb-41d0-9215-e67f49393db9 service nova] Creating event network-changed:90fe63af-3f5b-4170-8459-f2ece9a2abde for instance 672d60bf-f3f3-41af-80a8-3843b33aad78 on hv-cinder-84902 Jul 19 15:49:00.323834 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [req-d4761fa4-5bc4-4289-bed0-a09f9283ab65 req-3a8e51da-2afb-41d0-9215-e67f49393db9 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051844 Jul 19 15:49:00.324522 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 310/559] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Jul 19 15:49:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:49:00.422253 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-c0152309-346f-4233-8e3c-baa0b7758bea tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf2b338eac47f6bcf20a48770b2e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41bf5203b925421b9dd2ccc5b7d40ad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:00.430161 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-c0152309-346f-4233-8e3c-baa0b7758bea tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] 10.222.0.64 "GET /compute/v2.1/servers/672d60bf-f3f3-41af-80a8-3843b33aad78" status: 200 len: 1319 microversion: 2.1 time: 0.264746 Jul 19 15:49:00.430760 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 250/560] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:49:00 2022] GET /compute/v2.1/servers/672d60bf-f3f3-41af-80a8-3843b33aad78 => generated 1319 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:49:01.448925 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-57507be0-65b0-4282-965a-6f018136f1e8 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:01.449619 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-57507be0-65b0-4282-965a-6f018136f1e8 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] [instance: 672d60bf-f3f3-41af-80a8-3843b33aad78] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:01.456517 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-57507be0-65b0-4282-965a-6f018136f1e8 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:01.456965 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-57507be0-65b0-4282-965a-6f018136f1e8 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:01.457772 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-57507be0-65b0-4282-965a-6f018136f1e8 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:01.458210 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-57507be0-65b0-4282-965a-6f018136f1e8 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:01.590345 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-57507be0-65b0-4282-965a-6f018136f1e8 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf2b338eac47f6bcf20a48770b2e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41bf5203b925421b9dd2ccc5b7d40ad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:01.598423 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-57507be0-65b0-4282-965a-6f018136f1e8 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] 10.222.0.64 "GET /compute/v2.1/servers/672d60bf-f3f3-41af-80a8-3843b33aad78" status: 200 len: 1319 microversion: 2.1 time: 0.154205 Jul 19 15:49:01.598992 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 311/561] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:49:01 2022] GET /compute/v2.1/servers/672d60bf-f3f3-41af-80a8-3843b33aad78 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:49:02.615105 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-9fe5d01d-6daa-47ce-937e-c4bf20984b93 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:02.615701 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-9fe5d01d-6daa-47ce-937e-c4bf20984b93 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] [instance: 672d60bf-f3f3-41af-80a8-3843b33aad78] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:02.618020 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG dbcounter [-] [129519] Writing DB stats nova_api:SELECT=34 {{(pid=129519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:49:02.623319 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-9fe5d01d-6daa-47ce-937e-c4bf20984b93 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:02.623758 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-9fe5d01d-6daa-47ce-937e-c4bf20984b93 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:02.624507 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-9fe5d01d-6daa-47ce-937e-c4bf20984b93 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:02.625756 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-9fe5d01d-6daa-47ce-937e-c4bf20984b93 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:02.760109 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-9fe5d01d-6daa-47ce-937e-c4bf20984b93 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf2b338eac47f6bcf20a48770b2e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41bf5203b925421b9dd2ccc5b7d40ad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:02.767556 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-9fe5d01d-6daa-47ce-937e-c4bf20984b93 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] 10.222.0.64 "GET /compute/v2.1/servers/672d60bf-f3f3-41af-80a8-3843b33aad78" status: 200 len: 1319 microversion: 2.1 time: 0.156313 Jul 19 15:49:02.768153 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 251/562] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:49:02 2022] GET /compute/v2.1/servers/672d60bf-f3f3-41af-80a8-3843b33aad78 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:49:03.784895 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-d8369cf4-f2d1-42eb-ba76-9631e40cbfd2 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:03.785502 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-d8369cf4-f2d1-42eb-ba76-9631e40cbfd2 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] [instance: 672d60bf-f3f3-41af-80a8-3843b33aad78] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:03.792311 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-d8369cf4-f2d1-42eb-ba76-9631e40cbfd2 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:03.792763 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-d8369cf4-f2d1-42eb-ba76-9631e40cbfd2 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:03.793522 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-d8369cf4-f2d1-42eb-ba76-9631e40cbfd2 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:03.793956 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-d8369cf4-f2d1-42eb-ba76-9631e40cbfd2 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:03.921529 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-d8369cf4-f2d1-42eb-ba76-9631e40cbfd2 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf2b338eac47f6bcf20a48770b2e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41bf5203b925421b9dd2ccc5b7d40ad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:03.929526 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-d8369cf4-f2d1-42eb-ba76-9631e40cbfd2 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] 10.222.0.64 "GET /compute/v2.1/servers/672d60bf-f3f3-41af-80a8-3843b33aad78" status: 200 len: 1319 microversion: 2.1 time: 0.149104 Jul 19 15:49:03.930091 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 312/563] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:49:03 2022] GET /compute/v2.1/servers/672d60bf-f3f3-41af-80a8-3843b33aad78 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:49:04.399402 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [req-9f358bb5-65cf-4b1d-b628-ebe88e65fbfc req-e75a58cc-b74c-4501-ba26-247cba94f958 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "672d60bf-f3f3-41af-80a8-3843b33aad78", "name": "network-vif-plugged", "status": "completed", "tag": "90fe63af-3f5b-4170-8459-f2ece9a2abde"}]} {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:49:04.407908 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [req-9f358bb5-65cf-4b1d-b628-ebe88e65fbfc req-e75a58cc-b74c-4501-ba26-247cba94f958 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:04.408348 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [req-9f358bb5-65cf-4b1d-b628-ebe88e65fbfc req-e75a58cc-b74c-4501-ba26-247cba94f958 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:04.419621 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.compute.server_external_events [req-9f358bb5-65cf-4b1d-b628-ebe88e65fbfc req-e75a58cc-b74c-4501-ba26-247cba94f958 service nova] Creating event network-vif-plugged:90fe63af-3f5b-4170-8459-f2ece9a2abde for instance 672d60bf-f3f3-41af-80a8-3843b33aad78 on hv-cinder-84902 Jul 19 15:49:04.424750 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [req-9f358bb5-65cf-4b1d-b628-ebe88e65fbfc req-e75a58cc-b74c-4501-ba26-247cba94f958 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029244 Jul 19 15:49:04.425339 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 252/564] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Jul 19 15:49:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:49:04.946894 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-e8a5b6ce-c0f7-46f0-aa01-963c50f51a26 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:04.947436 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-e8a5b6ce-c0f7-46f0-aa01-963c50f51a26 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] [instance: 672d60bf-f3f3-41af-80a8-3843b33aad78] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:04.953847 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-e8a5b6ce-c0f7-46f0-aa01-963c50f51a26 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:04.954284 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-e8a5b6ce-c0f7-46f0-aa01-963c50f51a26 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:04.955100 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-e8a5b6ce-c0f7-46f0-aa01-963c50f51a26 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:04.955528 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-e8a5b6ce-c0f7-46f0-aa01-963c50f51a26 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:05.082216 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-e8a5b6ce-c0f7-46f0-aa01-963c50f51a26 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf2b338eac47f6bcf20a48770b2e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41bf5203b925421b9dd2ccc5b7d40ad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:05.089720 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-e8a5b6ce-c0f7-46f0-aa01-963c50f51a26 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] 10.222.0.64 "GET /compute/v2.1/servers/672d60bf-f3f3-41af-80a8-3843b33aad78" status: 200 len: 1319 microversion: 2.1 time: 0.146698 Jul 19 15:49:05.090315 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 313/565] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:49:04 2022] GET /compute/v2.1/servers/672d60bf-f3f3-41af-80a8-3843b33aad78 => generated 1319 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:49:06.106682 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-84934b78-d027-40fe-b445-20bb258222a2 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:06.107363 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-84934b78-d027-40fe-b445-20bb258222a2 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] [instance: 672d60bf-f3f3-41af-80a8-3843b33aad78] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:06.113727 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-84934b78-d027-40fe-b445-20bb258222a2 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:06.114165 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-84934b78-d027-40fe-b445-20bb258222a2 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:06.114938 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-84934b78-d027-40fe-b445-20bb258222a2 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:06.115367 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-84934b78-d027-40fe-b445-20bb258222a2 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:06.254483 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-84934b78-d027-40fe-b445-20bb258222a2 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf2b338eac47f6bcf20a48770b2e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41bf5203b925421b9dd2ccc5b7d40ad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:06.261982 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-84934b78-d027-40fe-b445-20bb258222a2 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] 10.222.0.64 "GET /compute/v2.1/servers/672d60bf-f3f3-41af-80a8-3843b33aad78" status: 200 len: 1319 microversion: 2.1 time: 0.159964 Jul 19 15:49:06.262559 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 253/566] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:49:06 2022] GET /compute/v2.1/servers/672d60bf-f3f3-41af-80a8-3843b33aad78 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:49:07.279016 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-3faf4c5c-0d23-4089-b6df-94b01ea1c22c tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:07.279617 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-3faf4c5c-0d23-4089-b6df-94b01ea1c22c tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] [instance: 672d60bf-f3f3-41af-80a8-3843b33aad78] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:07.286797 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-3faf4c5c-0d23-4089-b6df-94b01ea1c22c tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:07.287240 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-3faf4c5c-0d23-4089-b6df-94b01ea1c22c tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:07.288247 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-3faf4c5c-0d23-4089-b6df-94b01ea1c22c tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:07.288704 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-3faf4c5c-0d23-4089-b6df-94b01ea1c22c tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:07.420300 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-3faf4c5c-0d23-4089-b6df-94b01ea1c22c tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf2b338eac47f6bcf20a48770b2e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41bf5203b925421b9dd2ccc5b7d40ad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:07.427871 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-3faf4c5c-0d23-4089-b6df-94b01ea1c22c tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] 10.222.0.64 "GET /compute/v2.1/servers/672d60bf-f3f3-41af-80a8-3843b33aad78" status: 200 len: 1507 microversion: 2.1 time: 0.152679 Jul 19 15:49:07.428436 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 314/567] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:49:07 2022] GET /compute/v2.1/servers/672d60bf-f3f3-41af-80a8-3843b33aad78 => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:49:07.444835 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-8eb53399-6cec-45b9-bd1f-a7adad9330de tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e63b7498-ee04-4881-a1d4-ea3442b3dbb1", "device": "/dev/sdb"}} {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:49:07.446446 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-8eb53399-6cec-45b9-bd1f-a7adad9330de tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] [instance: 672d60bf-f3f3-41af-80a8-3843b33aad78] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:07.453979 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-8eb53399-6cec-45b9-bd1f-a7adad9330de tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:07.454434 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-8eb53399-6cec-45b9-bd1f-a7adad9330de tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:07.455189 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-8eb53399-6cec-45b9-bd1f-a7adad9330de tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:07.455614 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-8eb53399-6cec-45b9-bd1f-a7adad9330de tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:07.701713 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-8eb53399-6cec-45b9-bd1f-a7adad9330de tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] 10.222.0.64 "POST /compute/v2.1/servers/672d60bf-f3f3-41af-80a8-3843b33aad78/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.260703 Jul 19 15:49:07.702469 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 254/568] 10.222.0.64 () {60 vars in 1322 bytes} [Tue Jul 19 15:49:07 2022] POST /compute/v2.1/servers/672d60bf-f3f3-41af-80a8-3843b33aad78/os-volume_attachments => generated 194 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:49:15.511126 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-e32214aa-92a1-429a-849a-f35ffbdd99ff tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:15.511680 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-e32214aa-92a1-429a-849a-f35ffbdd99ff tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: 78bc17d6-5509-446d-a843-99a70b397128] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:15.513504 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG dbcounter [-] [129520] Writing DB stats nova_cell0:SELECT=2 {{(pid=129520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:49:15.514185 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG dbcounter [-] [129520] Writing DB stats nova_cell0:SELECT=6 {{(pid=129520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:49:15.514975 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG dbcounter [-] [129520] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=129520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:49:15.521799 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-e32214aa-92a1-429a-849a-f35ffbdd99ff tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:15.522241 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-e32214aa-92a1-429a-849a-f35ffbdd99ff tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:15.523033 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-e32214aa-92a1-429a-849a-f35ffbdd99ff tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:15.523471 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-e32214aa-92a1-429a-849a-f35ffbdd99ff tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:15.547556 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-e32214aa-92a1-429a-849a-f35ffbdd99ff tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/78bc17d6-5509-446d-a843-99a70b397128/ips" status: 200 len: 149 microversion: 2.1 time: 0.040475 Jul 19 15:49:15.548120 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 315/569] 10.222.0.64 () {58 vars in 1247 bytes} [Tue Jul 19 15:49:15 2022] GET /compute/v2.1/servers/78bc17d6-5509-446d-a843-99a70b397128/ips => generated 149 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:49:15.556100 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG dbcounter [-] [129519] Writing DB stats nova_cell0:SELECT=2 {{(pid=129519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:49:15.561009 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-12021fe3-7822-4080-bc9b-28e24b8c5d01 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "83467c1e-b417-4388-8ef3-ba7c30379327"}} {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:49:15.562200 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-12021fe3-7822-4080-bc9b-28e24b8c5d01 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: 78bc17d6-5509-446d-a843-99a70b397128] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:15.569184 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-12021fe3-7822-4080-bc9b-28e24b8c5d01 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:15.569635 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-12021fe3-7822-4080-bc9b-28e24b8c5d01 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:15.570414 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-12021fe3-7822-4080-bc9b-28e24b8c5d01 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:15.570882 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-12021fe3-7822-4080-bc9b-28e24b8c5d01 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:15.649329 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.wsgi [None req-12021fe3-7822-4080-bc9b-28e24b8c5d01 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] HTTP exception thrown: Invalid volume: volume 83467c1e-b417-4388-8ef3-ba7c30379327 is already attached to instances: 5f1579c0-907a-490f-ad8e-0fe2db0baf97 Jul 19 15:49:15.651066 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-12021fe3-7822-4080-bc9b-28e24b8c5d01 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Request method failure captured: Jul 19 15:49:15.651066 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: request: POST /compute/v2.1/servers/78bc17d6-5509-446d-a843-99a70b397128/os-volume_attachments HTTP/1.1 Jul 19 15:49:15.651066 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Accept: application/json Jul 19 15:49:15.651066 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Accept-Encoding: identity Jul 19 15:49:15.651066 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Connection: close Jul 19 15:49:15.651066 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Content-Length: 74 Jul 19 15:49:15.651066 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Content-Type: application/json Jul 19 15:49:15.651066 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Host: 10.222.0.64 Jul 19 15:49:15.651066 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Openstack-System-Scope: None Jul 19 15:49:15.651066 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: User-Agent: python-urllib3/1.26.9 Jul 19 15:49:15.651066 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Auth-Token: gAAAAABi1tGPtVnrBLo0yCDS-Fxp117KmoW30EOrAzeE-HWJZTaOLzmdVU7ilJLT24AK1cNZoT6hZsY9VJG83Xk6FPFrebHG3s54Fuj7pMRO-j7b_NklvH50XPBLW-GpDpGZ3ebrTqCiTKXUJEZA0zlfYPmMdreiVMLme-IYyDlHVZle_DtpLr0 Jul 19 15:49:15.651066 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Domain-Id: None Jul 19 15:49:15.651066 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Domain-Name: None Jul 19 15:49:15.651066 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Identity-Status: Confirmed Jul 19 15:49:15.651066 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Is-Admin-Project: True Jul 19 15:49:15.651066 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Domain-Id: default Jul 19 15:49:15.651066 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Domain-Name: Default Jul 19 15:49:15.651066 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Id: 45a72d232f314a78b0e1c3f04b0ed682 Jul 19 15:49:15.651066 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Name: tempest-AttachVolumeNegativeTest-1922780758 Jul 19 15:49:15.651066 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Role: member,reader Jul 19 15:49:15.651066 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Roles: member,reader Jul 19 15:49:15.652637 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_45a72d232f314a78b0e1c3f04b0ed682", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/45a72d232f314a78b0e1c3f04b0ed682"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/45a72d232f314a78b0e1c3f04b0ed682"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/45a72d232f314a78b0e1c3f04b0ed682"}]}] Jul 19 15:49:15.652637 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Tenant: tempest-AttachVolumeNegativeTest-1922780758 Jul 19 15:49:15.652637 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Tenant-Id: 45a72d232f314a78b0e1c3f04b0ed682 Jul 19 15:49:15.652637 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1922780758 Jul 19 15:49:15.652637 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User: tempest-AttachVolumeNegativeTest-1922780758-project Jul 19 15:49:15.652637 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Domain-Id: default Jul 19 15:49:15.652637 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Domain-Name: Default Jul 19 15:49:15.652637 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Id: 2d7c42cf0bc84292bb0b7edb9f2e7fc3 Jul 19 15:49:15.652637 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Name: tempest-AttachVolumeNegativeTest-1922780758-project Jul 19 15:49:15.652637 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Jul 19 15:49:15.652637 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: {"volumeAttachment": {"volumeId": "83467c1e-b417-4388-8ef3-ba7c30379327"}} Jul 19 15:49:15.652637 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: method: > Jul 19 15:49:15.653717 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: exception: Invalid volume: volume 83467c1e-b417-4388-8ef3-ba7c30379327 is already attached to instances: 5f1579c0-907a-490f-ad8e-0fe2db0baf97 Jul 19 15:49:15.653717 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: action_args: {'server_id': '78bc17d6-5509-446d-a843-99a70b397128', 'body': {'volumeAttachment': {'volumeId': '83467c1e-b417-4388-8ef3-ba7c30379327'}}} Jul 19 15:49:15.653717 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:49:15.653717 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:49:15.653717 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 19 15:49:15.653717 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 19 15:49:15.653717 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 19 15:49:15.653717 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 15:49:15.653717 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 19 15:49:15.653717 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 19 15:49:15.653717 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 19 15:49:15.653717 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 19 15:49:15.653717 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 19 15:49:15.653717 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 19 15:49:15.653717 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 83467c1e-b417-4388-8ef3-ba7c30379327 is already attached to instances: 5f1579c0-907a-490f-ad8e-0fe2db0baf97 Jul 19 15:49:15.653717 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:49:15.653717 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:49:15.653717 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:49:15.653717 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:49:15.655307 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:49:15.655307 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:49:15.655307 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:49:15.655307 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:49:15.655307 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:49:15.655307 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:49:15.655307 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 15:49:15.655307 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 15:49:15.655307 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 15:49:15.655307 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 15:49:15.655307 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 15:49:15.655307 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 15:49:15.655307 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 19 15:49:15.655307 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 19 15:49:15.655307 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 83467c1e-b417-4388-8ef3-ba7c30379327 is already attached to instances: 5f1579c0-907a-490f-ad8e-0fe2db0baf97 Jul 19 15:49:15.655307 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:49:15.655307 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:49:15.655307 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:49:15.655307 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:49:15.655307 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:49:15.657201 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:49:15.657201 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:49:15.657201 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:49:15.657201 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 83467c1e-b417-4388-8ef3-ba7c30379327 is already attached to instances: 5f1579c0-907a-490f-ad8e-0fe2db0baf97 Jul 19 15:49:15.657201 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:49:15.657201 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-12021fe3-7822-4080-bc9b-28e24b8c5d01 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Returning 400 to user: Invalid volume: volume 83467c1e-b417-4388-8ef3-ba7c30379327 is already attached to instances: 5f1579c0-907a-490f-ad8e-0fe2db0baf97 {{(pid=129519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:49:15.657201 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-12021fe3-7822-4080-bc9b-28e24b8c5d01 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "POST /compute/v2.1/servers/78bc17d6-5509-446d-a843-99a70b397128/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.097788 Jul 19 15:49:15.657201 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 255/570] 10.222.0.64 () {60 vars in 1322 bytes} [Tue Jul 19 15:49:15 2022] POST /compute/v2.1/servers/78bc17d6-5509-446d-a843-99a70b397128/os-volume_attachments => generated 174 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 15:49:15.661495 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-b14e5473-8dd2-4aae-80b5-98941c00e5d2 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:15.661991 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-b14e5473-8dd2-4aae-80b5-98941c00e5d2 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: 78bc17d6-5509-446d-a843-99a70b397128] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:15.668372 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b14e5473-8dd2-4aae-80b5-98941c00e5d2 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:15.668824 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b14e5473-8dd2-4aae-80b5-98941c00e5d2 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:15.670326 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b14e5473-8dd2-4aae-80b5-98941c00e5d2 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:15.670769 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b14e5473-8dd2-4aae-80b5-98941c00e5d2 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:15.697997 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-b14e5473-8dd2-4aae-80b5-98941c00e5d2 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: 78bc17d6-5509-446d-a843-99a70b397128] Going to try to terminate instance {{(pid=129520) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 15:49:15.775816 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-b14e5473-8dd2-4aae-80b5-98941c00e5d2 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "DELETE /compute/v2.1/servers/78bc17d6-5509-446d-a843-99a70b397128" status: 204 len: 0 microversion: 2.1 time: 0.117870 Jul 19 15:49:15.776303 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 316/571] 10.222.0.64 () {58 vars in 1238 bytes} [Tue Jul 19 15:49:15 2022] DELETE /compute/v2.1/servers/78bc17d6-5509-446d-a843-99a70b397128 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 15:49:15.784834 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-a0817ac6-049e-4095-a13c-cf03b8f561e0 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:15.785441 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-a0817ac6-049e-4095-a13c-cf03b8f561e0 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: 78bc17d6-5509-446d-a843-99a70b397128] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:15.792961 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-a0817ac6-049e-4095-a13c-cf03b8f561e0 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:15.793416 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-a0817ac6-049e-4095-a13c-cf03b8f561e0 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:15.794390 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-a0817ac6-049e-4095-a13c-cf03b8f561e0 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:15.794913 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-a0817ac6-049e-4095-a13c-cf03b8f561e0 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:15.923318 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-a0817ac6-049e-4095-a13c-cf03b8f561e0 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7c42cf0bc84292bb0b7edb9f2e7fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a72d232f314a78b0e1c3f04b0ed682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:15.930830 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-a0817ac6-049e-4095-a13c-cf03b8f561e0 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/78bc17d6-5509-446d-a843-99a70b397128" status: 200 len: 1681 microversion: 2.1 time: 0.150240 Jul 19 15:49:15.931391 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 256/572] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:49:15 2022] GET /compute/v2.1/servers/78bc17d6-5509-446d-a843-99a70b397128 => generated 1681 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:49:16.815578 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-707e0a76-a6eb-4cc6-8ddc-df65be7260d5 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b0fb4360-eb9d-4a23-87ae-d1f240088e56"}} {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:49:16.816706 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-707e0a76-a6eb-4cc6-8ddc-df65be7260d5 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 0194ecf2-5e08-49b2-a4e9-185bf9b32e40] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:16.823299 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-707e0a76-a6eb-4cc6-8ddc-df65be7260d5 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:16.823743 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-707e0a76-a6eb-4cc6-8ddc-df65be7260d5 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:16.824488 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-707e0a76-a6eb-4cc6-8ddc-df65be7260d5 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:16.824979 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-707e0a76-a6eb-4cc6-8ddc-df65be7260d5 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:16.948810 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-f6dd060d-8c65-4365-aa5a-0200e88cffc7 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:16.949330 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-f6dd060d-8c65-4365-aa5a-0200e88cffc7 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: 78bc17d6-5509-446d-a843-99a70b397128] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:16.956458 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-f6dd060d-8c65-4365-aa5a-0200e88cffc7 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:16.956901 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-f6dd060d-8c65-4365-aa5a-0200e88cffc7 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:16.957785 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-f6dd060d-8c65-4365-aa5a-0200e88cffc7 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:16.958095 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-f6dd060d-8c65-4365-aa5a-0200e88cffc7 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:17.085121 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-f6dd060d-8c65-4365-aa5a-0200e88cffc7 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7c42cf0bc84292bb0b7edb9f2e7fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a72d232f314a78b0e1c3f04b0ed682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:17.092520 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-f6dd060d-8c65-4365-aa5a-0200e88cffc7 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/78bc17d6-5509-446d-a843-99a70b397128" status: 200 len: 1681 microversion: 2.1 time: 0.147664 Jul 19 15:49:17.093085 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 257/573] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:49:16 2022] GET /compute/v2.1/servers/78bc17d6-5509-446d-a843-99a70b397128 => generated 1681 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:49:18.110898 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-e04d6cb5-9224-4b01-b290-5e5eba08dbaa tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:18.111647 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-e04d6cb5-9224-4b01-b290-5e5eba08dbaa tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: 78bc17d6-5509-446d-a843-99a70b397128] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:18.118081 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-e04d6cb5-9224-4b01-b290-5e5eba08dbaa tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:18.118560 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-e04d6cb5-9224-4b01-b290-5e5eba08dbaa tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:18.119312 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-e04d6cb5-9224-4b01-b290-5e5eba08dbaa tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:18.119744 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-e04d6cb5-9224-4b01-b290-5e5eba08dbaa tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:18.250997 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-e04d6cb5-9224-4b01-b290-5e5eba08dbaa tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7c42cf0bc84292bb0b7edb9f2e7fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a72d232f314a78b0e1c3f04b0ed682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:18.258596 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-e04d6cb5-9224-4b01-b290-5e5eba08dbaa tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/78bc17d6-5509-446d-a843-99a70b397128" status: 200 len: 1681 microversion: 2.1 time: 0.152116 Jul 19 15:49:18.259161 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 258/574] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:49:18 2022] GET /compute/v2.1/servers/78bc17d6-5509-446d-a843-99a70b397128 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:49:19.276235 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-dad3672c-5637-46d6-84b6-e0ff0d6a9fec tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:19.276902 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-dad3672c-5637-46d6-84b6-e0ff0d6a9fec tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: 78bc17d6-5509-446d-a843-99a70b397128] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:19.284924 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-dad3672c-5637-46d6-84b6-e0ff0d6a9fec tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:19.285534 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-dad3672c-5637-46d6-84b6-e0ff0d6a9fec tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:19.286668 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-dad3672c-5637-46d6-84b6-e0ff0d6a9fec tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:19.287436 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-dad3672c-5637-46d6-84b6-e0ff0d6a9fec tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:19.421914 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-dad3672c-5637-46d6-84b6-e0ff0d6a9fec tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7c42cf0bc84292bb0b7edb9f2e7fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a72d232f314a78b0e1c3f04b0ed682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:19.429634 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-dad3672c-5637-46d6-84b6-e0ff0d6a9fec tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/78bc17d6-5509-446d-a843-99a70b397128" status: 200 len: 1681 microversion: 2.1 time: 0.157223 Jul 19 15:49:19.430199 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 259/575] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:49:19 2022] GET /compute/v2.1/servers/78bc17d6-5509-446d-a843-99a70b397128 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:49:20.447276 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-9048a673-38d3-445a-b9da-927a9a83ccdb tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:20.447923 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-9048a673-38d3-445a-b9da-927a9a83ccdb tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: 78bc17d6-5509-446d-a843-99a70b397128] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:20.455038 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-9048a673-38d3-445a-b9da-927a9a83ccdb tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:20.455481 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-9048a673-38d3-445a-b9da-927a9a83ccdb tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:20.456226 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-9048a673-38d3-445a-b9da-927a9a83ccdb tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:20.456653 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-9048a673-38d3-445a-b9da-927a9a83ccdb tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:20.592247 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-9048a673-38d3-445a-b9da-927a9a83ccdb tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7c42cf0bc84292bb0b7edb9f2e7fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a72d232f314a78b0e1c3f04b0ed682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:20.600586 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-9048a673-38d3-445a-b9da-927a9a83ccdb tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/78bc17d6-5509-446d-a843-99a70b397128" status: 200 len: 1681 microversion: 2.1 time: 0.157107 Jul 19 15:49:20.601134 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 260/576] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:49:20 2022] GET /compute/v2.1/servers/78bc17d6-5509-446d-a843-99a70b397128 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:49:21.617255 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-6be0c26f-31f8-4e14-90ae-061e11cb8494 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:21.617855 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-6be0c26f-31f8-4e14-90ae-061e11cb8494 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: 78bc17d6-5509-446d-a843-99a70b397128] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:21.624225 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-6be0c26f-31f8-4e14-90ae-061e11cb8494 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:21.624665 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-6be0c26f-31f8-4e14-90ae-061e11cb8494 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:21.625415 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-6be0c26f-31f8-4e14-90ae-061e11cb8494 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:21.626418 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-6be0c26f-31f8-4e14-90ae-061e11cb8494 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:21.757088 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-6be0c26f-31f8-4e14-90ae-061e11cb8494 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7c42cf0bc84292bb0b7edb9f2e7fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a72d232f314a78b0e1c3f04b0ed682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:21.764612 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-6be0c26f-31f8-4e14-90ae-061e11cb8494 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/78bc17d6-5509-446d-a843-99a70b397128" status: 200 len: 1681 microversion: 2.1 time: 0.151246 Jul 19 15:49:21.765113 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 261/577] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:49:21 2022] GET /compute/v2.1/servers/78bc17d6-5509-446d-a843-99a70b397128 => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:49:22.693733 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-707e0a76-a6eb-4cc6-8ddc-df65be7260d5 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "POST /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 5.881983 Jul 19 15:49:22.694755 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 317/578] 10.222.0.64 () {60 vars in 1322 bytes} [Tue Jul 19 15:49:16 2022] POST /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40/os-volume_attachments => generated 194 bytes in 5884 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:49:22.782308 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-f9be0121-67c3-4ba8-be4c-db47b99c50f1 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:22.783028 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-f9be0121-67c3-4ba8-be4c-db47b99c50f1 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: 78bc17d6-5509-446d-a843-99a70b397128] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:22.789787 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-f9be0121-67c3-4ba8-be4c-db47b99c50f1 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:22.790202 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-f9be0121-67c3-4ba8-be4c-db47b99c50f1 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:22.791054 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-f9be0121-67c3-4ba8-be4c-db47b99c50f1 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:22.791486 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-f9be0121-67c3-4ba8-be4c-db47b99c50f1 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:22.959764 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-f9be0121-67c3-4ba8-be4c-db47b99c50f1 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7c42cf0bc84292bb0b7edb9f2e7fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a72d232f314a78b0e1c3f04b0ed682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:22.967313 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-f9be0121-67c3-4ba8-be4c-db47b99c50f1 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/78bc17d6-5509-446d-a843-99a70b397128" status: 200 len: 1681 microversion: 2.1 time: 0.188990 Jul 19 15:49:22.967875 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 262/579] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:49:22 2022] GET /compute/v2.1/servers/78bc17d6-5509-446d-a843-99a70b397128 => generated 1681 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:49:23.985728 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-8c2b09de-020b-43ef-95fd-b37e13e42ecb tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:23.986711 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-8c2b09de-020b-43ef-95fd-b37e13e42ecb tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: 78bc17d6-5509-446d-a843-99a70b397128] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:23.994130 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-8c2b09de-020b-43ef-95fd-b37e13e42ecb tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:23.994602 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-8c2b09de-020b-43ef-95fd-b37e13e42ecb tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:23.995362 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-8c2b09de-020b-43ef-95fd-b37e13e42ecb tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:23.995828 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-8c2b09de-020b-43ef-95fd-b37e13e42ecb tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:24.146266 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-8c2b09de-020b-43ef-95fd-b37e13e42ecb tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7c42cf0bc84292bb0b7edb9f2e7fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a72d232f314a78b0e1c3f04b0ed682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:24.153902 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-8c2b09de-020b-43ef-95fd-b37e13e42ecb tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/78bc17d6-5509-446d-a843-99a70b397128" status: 200 len: 1681 microversion: 2.1 time: 0.173020 Jul 19 15:49:24.154503 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 318/580] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:49:23 2022] GET /compute/v2.1/servers/78bc17d6-5509-446d-a843-99a70b397128 => generated 1681 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:49:24.460052 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [req-cf01bbdd-5a82-47ad-a218-f4a1a4f2723b req-677e1e4a-34ff-483b-a7b4-f62759524bcc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "78bc17d6-5509-446d-a843-99a70b397128", "name": "network-vif-deleted", "tag": "41689fce-682e-44b2-a26f-83d31eb3790b"}]} {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:49:24.475938 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [req-cf01bbdd-5a82-47ad-a218-f4a1a4f2723b req-677e1e4a-34ff-483b-a7b4-f62759524bcc service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:24.476692 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [req-cf01bbdd-5a82-47ad-a218-f4a1a4f2723b req-677e1e4a-34ff-483b-a7b4-f62759524bcc service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:24.489454 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.compute.server_external_events [req-cf01bbdd-5a82-47ad-a218-f4a1a4f2723b req-677e1e4a-34ff-483b-a7b4-f62759524bcc service nova] Creating event network-vif-deleted:41689fce-682e-44b2-a26f-83d31eb3790b for instance 78bc17d6-5509-446d-a843-99a70b397128 on hv-cinder-84902 Jul 19 15:49:24.495567 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [req-cf01bbdd-5a82-47ad-a218-f4a1a4f2723b req-677e1e4a-34ff-483b-a7b4-f62759524bcc service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038969 Jul 19 15:49:24.496382 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 263/581] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Jul 19 15:49:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 15:49:25.172203 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-da0b30b3-1828-4c49-b58f-aa3d43a86b3c tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:25.172956 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-da0b30b3-1828-4c49-b58f-aa3d43a86b3c tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: 78bc17d6-5509-446d-a843-99a70b397128] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:25.179582 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-da0b30b3-1828-4c49-b58f-aa3d43a86b3c tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:25.180030 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-da0b30b3-1828-4c49-b58f-aa3d43a86b3c tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:25.180927 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-da0b30b3-1828-4c49-b58f-aa3d43a86b3c tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:25.181367 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-da0b30b3-1828-4c49-b58f-aa3d43a86b3c tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:25.216834 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-da0b30b3-1828-4c49-b58f-aa3d43a86b3c tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:25.217350 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-da0b30b3-1828-4c49-b58f-aa3d43a86b3c tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:25.217872 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.objects.instance [None req-da0b30b3-1828-4c49-b58f-aa3d43a86b3c tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lazy-loading 'fault' on Instance uuid 78bc17d6-5509-446d-a843-99a70b397128 {{(pid=129520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 15:49:25.263796 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-da0b30b3-1828-4c49-b58f-aa3d43a86b3c tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7c42cf0bc84292bb0b7edb9f2e7fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a72d232f314a78b0e1c3f04b0ed682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:25.272274 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-da0b30b3-1828-4c49-b58f-aa3d43a86b3c tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/78bc17d6-5509-446d-a843-99a70b397128" status: 200 len: 1331 microversion: 2.1 time: 0.104034 Jul 19 15:49:25.272854 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 319/582] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:49:25 2022] GET /compute/v2.1/servers/78bc17d6-5509-446d-a843-99a70b397128 => generated 1331 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:49:26.290670 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-a872e927-2558-4723-92f8-e3967e11eb45 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:26.291258 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-a872e927-2558-4723-92f8-e3967e11eb45 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: 78bc17d6-5509-446d-a843-99a70b397128] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:26.297674 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-a872e927-2558-4723-92f8-e3967e11eb45 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:26.298117 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-a872e927-2558-4723-92f8-e3967e11eb45 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:26.298906 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-a872e927-2558-4723-92f8-e3967e11eb45 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:26.299337 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-a872e927-2558-4723-92f8-e3967e11eb45 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:26.312854 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.wsgi [None req-a872e927-2558-4723-92f8-e3967e11eb45 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] HTTP exception thrown: Instance 78bc17d6-5509-446d-a843-99a70b397128 could not be found. Jul 19 15:49:26.315051 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-a872e927-2558-4723-92f8-e3967e11eb45 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Request method failure captured: Jul 19 15:49:26.315051 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: request: GET /compute/v2.1/servers/78bc17d6-5509-446d-a843-99a70b397128 HTTP/1.1 Jul 19 15:49:26.315051 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Accept: application/json Jul 19 15:49:26.315051 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Accept-Encoding: identity Jul 19 15:49:26.315051 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Connection: close Jul 19 15:49:26.315051 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Content-Length: 0 Jul 19 15:49:26.315051 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Content-Type: application/json Jul 19 15:49:26.315051 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Host: 10.222.0.64 Jul 19 15:49:26.315051 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Openstack-System-Scope: None Jul 19 15:49:26.315051 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: User-Agent: python-urllib3/1.26.9 Jul 19 15:49:26.315051 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Auth-Token: gAAAAABi1tGPtVnrBLo0yCDS-Fxp117KmoW30EOrAzeE-HWJZTaOLzmdVU7ilJLT24AK1cNZoT6hZsY9VJG83Xk6FPFrebHG3s54Fuj7pMRO-j7b_NklvH50XPBLW-GpDpGZ3ebrTqCiTKXUJEZA0zlfYPmMdreiVMLme-IYyDlHVZle_DtpLr0 Jul 19 15:49:26.315051 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Domain-Id: None Jul 19 15:49:26.315051 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Domain-Name: None Jul 19 15:49:26.315051 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Identity-Status: Confirmed Jul 19 15:49:26.315051 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Is-Admin-Project: True Jul 19 15:49:26.315051 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Domain-Id: default Jul 19 15:49:26.315051 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Domain-Name: Default Jul 19 15:49:26.315051 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Id: 45a72d232f314a78b0e1c3f04b0ed682 Jul 19 15:49:26.315051 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Name: tempest-AttachVolumeNegativeTest-1922780758 Jul 19 15:49:26.315051 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Role: member,reader Jul 19 15:49:26.315051 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Roles: member,reader Jul 19 15:49:26.316559 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_45a72d232f314a78b0e1c3f04b0ed682", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/45a72d232f314a78b0e1c3f04b0ed682"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/45a72d232f314a78b0e1c3f04b0ed682"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/45a72d232f314a78b0e1c3f04b0ed682"}]}] Jul 19 15:49:26.316559 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Tenant: tempest-AttachVolumeNegativeTest-1922780758 Jul 19 15:49:26.316559 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Tenant-Id: 45a72d232f314a78b0e1c3f04b0ed682 Jul 19 15:49:26.316559 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1922780758 Jul 19 15:49:26.316559 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User: tempest-AttachVolumeNegativeTest-1922780758-project Jul 19 15:49:26.316559 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Domain-Id: default Jul 19 15:49:26.316559 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Domain-Name: Default Jul 19 15:49:26.316559 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Id: 2d7c42cf0bc84292bb0b7edb9f2e7fc3 Jul 19 15:49:26.316559 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Name: tempest-AttachVolumeNegativeTest-1922780758-project Jul 19 15:49:26.316559 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: method: > Jul 19 15:49:26.316559 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: exception: Instance 78bc17d6-5509-446d-a843-99a70b397128 could not be found. Jul 19 15:49:26.316559 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: action_args: {'id': '78bc17d6-5509-446d-a843-99a70b397128'} Jul 19 15:49:26.317488 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:49:26.317488 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:49:26.317488 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 15:49:26.317488 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 15:49:26.317488 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 15:49:26.317488 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 15:49:26.317488 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 15:49:26.317488 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 15:49:26.317488 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 15:49:26.317488 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 15:49:26.317488 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78bc17d6-5509-446d-a843-99a70b397128 could not be found. Jul 19 15:49:26.317488 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:49:26.317488 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:49:26.317488 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:49:26.317488 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:49:26.317488 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:49:26.317488 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:49:26.317488 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:49:26.317488 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:49:26.317488 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:49:26.318789 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:49:26.318789 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 15:49:26.318789 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 15:49:26.318789 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 15:49:26.318789 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 15:49:26.318789 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 15:49:26.318789 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 15:49:26.318789 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78bc17d6-5509-446d-a843-99a70b397128 could not be found. Jul 19 15:49:26.318789 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:49:26.318789 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:49:26.318789 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:49:26.318789 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:49:26.318789 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:49:26.318789 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:49:26.318789 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:49:26.318789 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:49:26.318789 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78bc17d6-5509-446d-a843-99a70b397128 could not be found. Jul 19 15:49:26.318789 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:49:26.319933 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-a872e927-2558-4723-92f8-e3967e11eb45 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Returning 404 to user: Instance 78bc17d6-5509-446d-a843-99a70b397128 could not be found. {{(pid=129519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:49:26.319933 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-a872e927-2558-4723-92f8-e3967e11eb45 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/78bc17d6-5509-446d-a843-99a70b397128" status: 404 len: 111 microversion: 2.1 time: 0.031031 Jul 19 15:49:26.319933 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 264/583] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:49:26 2022] GET /compute/v2.1/servers/78bc17d6-5509-446d-a843-99a70b397128 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 15:49:26.325326 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-ffa2b68c-60d5-4af6-81aa-97efe9f11988 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '.version_select at 0x7fb8a5bfcaf0>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:26.343796 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-ffa2b68c-60d5-4af6-81aa-97efe9f11988 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-101818663" status: 202 len: 0 microversion: 2.1 time: 0.022283 Jul 19 15:49:26.344343 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 320/584] 10.222.0.64 () {58 vars in 1217 bytes} [Tue Jul 19 15:49:26 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-101818663 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 15:49:27.017700 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-d37e95b1-bf6c-4f33-abd3-7e1ac896f939 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:27.018243 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-d37e95b1-bf6c-4f33-abd3-7e1ac896f939 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: 5f1579c0-907a-490f-ad8e-0fe2db0baf97] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:27.024333 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-d37e95b1-bf6c-4f33-abd3-7e1ac896f939 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:27.024780 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-d37e95b1-bf6c-4f33-abd3-7e1ac896f939 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:27.025535 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-d37e95b1-bf6c-4f33-abd3-7e1ac896f939 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:27.025970 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-d37e95b1-bf6c-4f33-abd3-7e1ac896f939 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:27.050336 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-bd3c39c0-e9be-4e00-ac7c-0002f39f4f86 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:27.050853 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-bd3c39c0-e9be-4e00-ac7c-0002f39f4f86 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] [instance: 672d60bf-f3f3-41af-80a8-3843b33aad78] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:27.056821 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-bd3c39c0-e9be-4e00-ac7c-0002f39f4f86 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:27.057267 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-bd3c39c0-e9be-4e00-ac7c-0002f39f4f86 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:27.058018 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-bd3c39c0-e9be-4e00-ac7c-0002f39f4f86 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:27.058475 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-bd3c39c0-e9be-4e00-ac7c-0002f39f4f86 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:27.107405 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.objects.instance [None req-d37e95b1-bf6c-4f33-abd3-7e1ac896f939 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lazy-loading 'services' on Instance uuid 5f1579c0-907a-490f-ad8e-0fe2db0baf97 {{(pid=129519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 15:49:27.180322 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-d37e95b1-bf6c-4f33-abd3-7e1ac896f939 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "DELETE /compute/v2.1/servers/5f1579c0-907a-490f-ad8e-0fe2db0baf97/os-volume_attachments/83467c1e-b417-4388-8ef3-ba7c30379327" status: 202 len: 0 microversion: 2.1 time: 0.166520 Jul 19 15:49:27.180953 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 265/585] 10.222.0.64 () {58 vars in 1415 bytes} [Tue Jul 19 15:49:27 2022] DELETE /compute/v2.1/servers/5f1579c0-907a-490f-ad8e-0fe2db0baf97/os-volume_attachments/83467c1e-b417-4388-8ef3-ba7c30379327 => generated 0 bytes in 168 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 15:49:27.181863 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.objects.instance [None req-bd3c39c0-e9be-4e00-ac7c-0002f39f4f86 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lazy-loading 'services' on Instance uuid 672d60bf-f3f3-41af-80a8-3843b33aad78 {{(pid=129520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 15:49:27.189550 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-299e6d6a-d930-4ffe-a930-6334f112a2d1 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:27.190660 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-299e6d6a-d930-4ffe-a930-6334f112a2d1 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: 5f1579c0-907a-490f-ad8e-0fe2db0baf97] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:27.197341 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-299e6d6a-d930-4ffe-a930-6334f112a2d1 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:27.197784 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-299e6d6a-d930-4ffe-a930-6334f112a2d1 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:27.198597 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-299e6d6a-d930-4ffe-a930-6334f112a2d1 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:27.199049 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-299e6d6a-d930-4ffe-a930-6334f112a2d1 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:27.217156 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG dbcounter [-] [129519] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:49:27.233352 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-299e6d6a-d930-4ffe-a930-6334f112a2d1 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/5f1579c0-907a-490f-ad8e-0fe2db0baf97/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047835 Jul 19 15:49:27.234393 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 266/586] 10.222.0.64 () {58 vars in 1301 bytes} [Tue Jul 19 15:49:27 2022] GET /compute/v2.1/servers/5f1579c0-907a-490f-ad8e-0fe2db0baf97/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 15:49:27.303130 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-bd3c39c0-e9be-4e00-ac7c-0002f39f4f86 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] 10.222.0.64 "DELETE /compute/v2.1/servers/672d60bf-f3f3-41af-80a8-3843b33aad78/os-volume_attachments/e63b7498-ee04-4881-a1d4-ea3442b3dbb1" status: 202 len: 0 microversion: 2.1 time: 0.256682 Jul 19 15:49:27.303822 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 321/587] 10.222.0.64 () {58 vars in 1415 bytes} [Tue Jul 19 15:49:27 2022] DELETE /compute/v2.1/servers/672d60bf-f3f3-41af-80a8-3843b33aad78/os-volume_attachments/e63b7498-ee04-4881-a1d4-ea3442b3dbb1 => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 19 15:49:28.244868 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-f89b200f-d3f5-40e0-912f-f5f7380f3d7b tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:28.245709 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-f89b200f-d3f5-40e0-912f-f5f7380f3d7b tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: 5f1579c0-907a-490f-ad8e-0fe2db0baf97] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:28.252708 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-f89b200f-d3f5-40e0-912f-f5f7380f3d7b tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:28.253149 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-f89b200f-d3f5-40e0-912f-f5f7380f3d7b tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:28.253901 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-f89b200f-d3f5-40e0-912f-f5f7380f3d7b tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:28.254328 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-f89b200f-d3f5-40e0-912f-f5f7380f3d7b tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:28.284142 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-f89b200f-d3f5-40e0-912f-f5f7380f3d7b tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/5f1579c0-907a-490f-ad8e-0fe2db0baf97/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043531 Jul 19 15:49:28.284714 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 267/588] 10.222.0.64 () {58 vars in 1301 bytes} [Tue Jul 19 15:49:28 2022] GET /compute/v2.1/servers/5f1579c0-907a-490f-ad8e-0fe2db0baf97/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:49:29.296533 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-e9fe2b7c-55f6-4f06-9eac-44ff9c9b1789 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:29.297538 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-e9fe2b7c-55f6-4f06-9eac-44ff9c9b1789 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: 5f1579c0-907a-490f-ad8e-0fe2db0baf97] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:29.304415 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-e9fe2b7c-55f6-4f06-9eac-44ff9c9b1789 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:29.304865 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-e9fe2b7c-55f6-4f06-9eac-44ff9c9b1789 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:29.305627 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-e9fe2b7c-55f6-4f06-9eac-44ff9c9b1789 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:29.306062 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-e9fe2b7c-55f6-4f06-9eac-44ff9c9b1789 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:29.309725 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG dbcounter [-] [129520] Writing DB stats nova_cell1:SELECT=87,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=129520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:49:29.340206 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-e9fe2b7c-55f6-4f06-9eac-44ff9c9b1789 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/5f1579c0-907a-490f-ad8e-0fe2db0baf97/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048081 Jul 19 15:49:29.340775 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 322/589] 10.222.0.64 () {58 vars in 1301 bytes} [Tue Jul 19 15:49:29 2022] GET /compute/v2.1/servers/5f1579c0-907a-490f-ad8e-0fe2db0baf97/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:49:30.208279 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-0571f70d-8f04-4578-abf2-af81a85d52ca tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:49:30.209215 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-0571f70d-8f04-4578-abf2-af81a85d52ca tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 0194ecf2-5e08-49b2-a4e9-185bf9b32e40] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:30.215612 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-0571f70d-8f04-4578-abf2-af81a85d52ca tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:30.216061 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-0571f70d-8f04-4578-abf2-af81a85d52ca tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:30.216817 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-0571f70d-8f04-4578-abf2-af81a85d52ca tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:30.217252 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-0571f70d-8f04-4578-abf2-af81a85d52ca tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:30.239973 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.objects.instance [None req-0571f70d-8f04-4578-abf2-af81a85d52ca tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lazy-loading 'flavor' on Instance uuid 0194ecf2-5e08-49b2-a4e9-185bf9b32e40 {{(pid=129519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 15:49:30.352018 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-10aa1872-668f-4ca2-9036-f6d004add3d6 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:30.352936 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-10aa1872-668f-4ca2-9036-f6d004add3d6 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: 5f1579c0-907a-490f-ad8e-0fe2db0baf97] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:30.359623 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-10aa1872-668f-4ca2-9036-f6d004add3d6 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:30.360738 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-10aa1872-668f-4ca2-9036-f6d004add3d6 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:30.361766 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-10aa1872-668f-4ca2-9036-f6d004add3d6 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:30.362209 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-10aa1872-668f-4ca2-9036-f6d004add3d6 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:30.370907 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-0571f70d-8f04-4578-abf2-af81a85d52ca tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "POST /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40/action" status: 200 len: 32 microversion: 2.1 time: 0.167289 Jul 19 15:49:30.376993 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 268/590] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Jul 19 15:49:30 2022] POST /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40/action => generated 32 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 15:49:30.387844 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-2c7e0d42-434b-40ea-bd1f-deadba8916e9 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:30.389213 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-2c7e0d42-434b-40ea-bd1f-deadba8916e9 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 0194ecf2-5e08-49b2-a4e9-185bf9b32e40] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:30.394497 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-10aa1872-668f-4ca2-9036-f6d004add3d6 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/5f1579c0-907a-490f-ad8e-0fe2db0baf97/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046638 Jul 19 15:49:30.398223 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 323/591] 10.222.0.64 () {58 vars in 1301 bytes} [Tue Jul 19 15:49:30 2022] GET /compute/v2.1/servers/5f1579c0-907a-490f-ad8e-0fe2db0baf97/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 15:49:30.402096 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-2c7e0d42-434b-40ea-bd1f-deadba8916e9 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:30.403177 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-2c7e0d42-434b-40ea-bd1f-deadba8916e9 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:30.405168 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-2c7e0d42-434b-40ea-bd1f-deadba8916e9 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:30.406122 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-2c7e0d42-434b-40ea-bd1f-deadba8916e9 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:30.576105 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-2c7e0d42-434b-40ea-bd1f-deadba8916e9 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:30.584567 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-2c7e0d42-434b-40ea-bd1f-deadba8916e9 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40" status: 200 len: 1735 microversion: 2.1 time: 0.204679 Jul 19 15:49:30.585134 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 269/592] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:49:30 2022] GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40 => generated 1735 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:49:31.405225 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-5325a4a4-67b4-4f89-9f10-396f8f032690 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:31.406144 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-5325a4a4-67b4-4f89-9f10-396f8f032690 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: 5f1579c0-907a-490f-ad8e-0fe2db0baf97] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:31.412940 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-5325a4a4-67b4-4f89-9f10-396f8f032690 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:31.413648 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-5325a4a4-67b4-4f89-9f10-396f8f032690 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:31.414441 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-5325a4a4-67b4-4f89-9f10-396f8f032690 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:31.414877 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-5325a4a4-67b4-4f89-9f10-396f8f032690 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:31.445720 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-5325a4a4-67b4-4f89-9f10-396f8f032690 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/5f1579c0-907a-490f-ad8e-0fe2db0baf97/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044439 Jul 19 15:49:31.446282 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 324/593] 10.222.0.64 () {58 vars in 1301 bytes} [Tue Jul 19 15:49:31 2022] GET /compute/v2.1/servers/5f1579c0-907a-490f-ad8e-0fe2db0baf97/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 15:49:31.504100 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-ee2b5a9d-bc5a-4dc6-9f71-3d240c49142e tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:31.504621 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-ee2b5a9d-bc5a-4dc6-9f71-3d240c49142e tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: 5f1579c0-907a-490f-ad8e-0fe2db0baf97] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:31.511538 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-ee2b5a9d-bc5a-4dc6-9f71-3d240c49142e tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:31.511920 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-ee2b5a9d-bc5a-4dc6-9f71-3d240c49142e tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:31.512818 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-ee2b5a9d-bc5a-4dc6-9f71-3d240c49142e tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:31.513251 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-ee2b5a9d-bc5a-4dc6-9f71-3d240c49142e tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:31.539463 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-ee2b5a9d-bc5a-4dc6-9f71-3d240c49142e tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: 5f1579c0-907a-490f-ad8e-0fe2db0baf97] Going to try to terminate instance {{(pid=129519) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 15:49:31.579851 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-1d74f4ab-425a-4c0e-bdea-2aadde294d4d tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:31.580351 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-1d74f4ab-425a-4c0e-bdea-2aadde294d4d tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] [instance: 672d60bf-f3f3-41af-80a8-3843b33aad78] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:31.586412 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-1d74f4ab-425a-4c0e-bdea-2aadde294d4d tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:31.586869 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-1d74f4ab-425a-4c0e-bdea-2aadde294d4d tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:31.587633 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-1d74f4ab-425a-4c0e-bdea-2aadde294d4d tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:31.588073 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-1d74f4ab-425a-4c0e-bdea-2aadde294d4d tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:31.613825 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-1d74f4ab-425a-4c0e-bdea-2aadde294d4d tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] [instance: 672d60bf-f3f3-41af-80a8-3843b33aad78] Going to try to terminate instance {{(pid=129520) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 15:49:31.624990 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-ee2b5a9d-bc5a-4dc6-9f71-3d240c49142e tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "DELETE /compute/v2.1/servers/5f1579c0-907a-490f-ad8e-0fe2db0baf97" status: 204 len: 0 microversion: 2.1 time: 0.124807 Jul 19 15:49:31.626597 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 270/594] 10.222.0.64 () {58 vars in 1238 bytes} [Tue Jul 19 15:49:31 2022] DELETE /compute/v2.1/servers/5f1579c0-907a-490f-ad8e-0fe2db0baf97 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 15:49:31.631909 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-fbf2bc81-a025-4a7b-9cda-79fa902a2236 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:31.632595 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-fbf2bc81-a025-4a7b-9cda-79fa902a2236 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 0194ecf2-5e08-49b2-a4e9-185bf9b32e40] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:31.638323 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-fbf2bc81-a025-4a7b-9cda-79fa902a2236 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:31.638824 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-fbf2bc81-a025-4a7b-9cda-79fa902a2236 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:31.639580 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-fbf2bc81-a025-4a7b-9cda-79fa902a2236 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:31.640011 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-fbf2bc81-a025-4a7b-9cda-79fa902a2236 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:31.697835 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-1d74f4ab-425a-4c0e-bdea-2aadde294d4d tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] 10.222.0.64 "DELETE /compute/v2.1/servers/672d60bf-f3f3-41af-80a8-3843b33aad78" status: 204 len: 0 microversion: 2.1 time: 0.122160 Jul 19 15:49:31.698543 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 325/595] 10.222.0.64 () {58 vars in 1238 bytes} [Tue Jul 19 15:49:31 2022] DELETE /compute/v2.1/servers/672d60bf-f3f3-41af-80a8-3843b33aad78 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 19 15:49:31.703937 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-092b2ab3-08d8-490a-8247-dd3e6c912647 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:31.704632 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-092b2ab3-08d8-490a-8247-dd3e6c912647 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: 5f1579c0-907a-490f-ad8e-0fe2db0baf97] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:31.710932 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-092b2ab3-08d8-490a-8247-dd3e6c912647 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:31.711377 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-092b2ab3-08d8-490a-8247-dd3e6c912647 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:31.712138 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-092b2ab3-08d8-490a-8247-dd3e6c912647 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:31.712570 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-092b2ab3-08d8-490a-8247-dd3e6c912647 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:31.777179 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-fbf2bc81-a025-4a7b-9cda-79fa902a2236 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:31.785367 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-fbf2bc81-a025-4a7b-9cda-79fa902a2236 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40" status: 200 len: 1735 microversion: 2.1 time: 0.157478 Jul 19 15:49:31.786004 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 271/596] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:49:31 2022] GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:49:31.790713 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-ca810e12-deeb-45a8-ba6f-285518602ff9 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:31.791316 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-ca810e12-deeb-45a8-ba6f-285518602ff9 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] [instance: 672d60bf-f3f3-41af-80a8-3843b33aad78] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:31.798277 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-ca810e12-deeb-45a8-ba6f-285518602ff9 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:31.798747 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-ca810e12-deeb-45a8-ba6f-285518602ff9 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:31.799502 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-ca810e12-deeb-45a8-ba6f-285518602ff9 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:31.799934 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-ca810e12-deeb-45a8-ba6f-285518602ff9 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:31.850656 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-092b2ab3-08d8-490a-8247-dd3e6c912647 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7c42cf0bc84292bb0b7edb9f2e7fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a72d232f314a78b0e1c3f04b0ed682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:31.858279 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-092b2ab3-08d8-490a-8247-dd3e6c912647 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/5f1579c0-907a-490f-ad8e-0fe2db0baf97" status: 200 len: 1681 microversion: 2.1 time: 0.158417 Jul 19 15:49:31.858880 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 326/597] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:49:31 2022] GET /compute/v2.1/servers/5f1579c0-907a-490f-ad8e-0fe2db0baf97 => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:49:31.936508 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-ca810e12-deeb-45a8-ba6f-285518602ff9 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf2b338eac47f6bcf20a48770b2e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41bf5203b925421b9dd2ccc5b7d40ad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:31.944243 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-ca810e12-deeb-45a8-ba6f-285518602ff9 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] 10.222.0.64 "GET /compute/v2.1/servers/672d60bf-f3f3-41af-80a8-3843b33aad78" status: 200 len: 1513 microversion: 2.1 time: 0.157281 Jul 19 15:49:31.944798 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 272/598] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:49:31 2022] GET /compute/v2.1/servers/672d60bf-f3f3-41af-80a8-3843b33aad78 => generated 1513 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:49:32.803188 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-0ec95fc9-d6e3-48b9-ae28-229d67611233 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:32.803785 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-0ec95fc9-d6e3-48b9-ae28-229d67611233 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 0194ecf2-5e08-49b2-a4e9-185bf9b32e40] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:32.810294 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-0ec95fc9-d6e3-48b9-ae28-229d67611233 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:32.810770 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-0ec95fc9-d6e3-48b9-ae28-229d67611233 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:32.811514 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-0ec95fc9-d6e3-48b9-ae28-229d67611233 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:32.811940 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-0ec95fc9-d6e3-48b9-ae28-229d67611233 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:32.875560 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-93a29f47-d240-407b-a89c-10c09a993b98 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:32.876396 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-93a29f47-d240-407b-a89c-10c09a993b98 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: 5f1579c0-907a-490f-ad8e-0fe2db0baf97] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:32.879018 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG dbcounter [-] [129519] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=129519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:49:32.884679 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-93a29f47-d240-407b-a89c-10c09a993b98 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:32.885127 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-93a29f47-d240-407b-a89c-10c09a993b98 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:32.885898 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-93a29f47-d240-407b-a89c-10c09a993b98 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:32.886331 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-93a29f47-d240-407b-a89c-10c09a993b98 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:32.946144 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-0ec95fc9-d6e3-48b9-ae28-229d67611233 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:32.956937 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-0ec95fc9-d6e3-48b9-ae28-229d67611233 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40" status: 200 len: 1735 microversion: 2.1 time: 0.157601 Jul 19 15:49:32.957802 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 327/599] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:49:32 2022] GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40 => generated 1735 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:49:32.962608 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-1cea62ae-6b08-4730-b19f-ba28d24af2e5 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:32.963217 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-1cea62ae-6b08-4730-b19f-ba28d24af2e5 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] [instance: 672d60bf-f3f3-41af-80a8-3843b33aad78] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:32.969158 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-1cea62ae-6b08-4730-b19f-ba28d24af2e5 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:32.969623 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-1cea62ae-6b08-4730-b19f-ba28d24af2e5 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:32.970528 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-1cea62ae-6b08-4730-b19f-ba28d24af2e5 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:32.970967 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-1cea62ae-6b08-4730-b19f-ba28d24af2e5 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:33.020283 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-93a29f47-d240-407b-a89c-10c09a993b98 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7c42cf0bc84292bb0b7edb9f2e7fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a72d232f314a78b0e1c3f04b0ed682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:33.027745 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-93a29f47-d240-407b-a89c-10c09a993b98 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/5f1579c0-907a-490f-ad8e-0fe2db0baf97" status: 200 len: 1681 microversion: 2.1 time: 0.156110 Jul 19 15:49:33.028309 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 273/600] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:49:32 2022] GET /compute/v2.1/servers/5f1579c0-907a-490f-ad8e-0fe2db0baf97 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:49:33.101872 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-1cea62ae-6b08-4730-b19f-ba28d24af2e5 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf2b338eac47f6bcf20a48770b2e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41bf5203b925421b9dd2ccc5b7d40ad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:33.109775 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-1cea62ae-6b08-4730-b19f-ba28d24af2e5 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] 10.222.0.64 "GET /compute/v2.1/servers/672d60bf-f3f3-41af-80a8-3843b33aad78" status: 200 len: 1513 microversion: 2.1 time: 0.150831 Jul 19 15:49:33.110449 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 328/601] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:49:32 2022] GET /compute/v2.1/servers/672d60bf-f3f3-41af-80a8-3843b33aad78 => generated 1513 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:49:33.975252 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-0322fc91-4f86-4beb-bc01-b52ab6dd5e18 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:33.975888 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-0322fc91-4f86-4beb-bc01-b52ab6dd5e18 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 0194ecf2-5e08-49b2-a4e9-185bf9b32e40] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:33.982326 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-0322fc91-4f86-4beb-bc01-b52ab6dd5e18 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:33.982809 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-0322fc91-4f86-4beb-bc01-b52ab6dd5e18 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:33.983566 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-0322fc91-4f86-4beb-bc01-b52ab6dd5e18 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:33.984004 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-0322fc91-4f86-4beb-bc01-b52ab6dd5e18 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:34.045025 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-d88b5b58-1da5-4895-9611-cdfb4093aa56 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:34.045670 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-d88b5b58-1da5-4895-9611-cdfb4093aa56 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: 5f1579c0-907a-490f-ad8e-0fe2db0baf97] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:34.052338 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-d88b5b58-1da5-4895-9611-cdfb4093aa56 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:34.052783 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-d88b5b58-1da5-4895-9611-cdfb4093aa56 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:34.053546 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-d88b5b58-1da5-4895-9611-cdfb4093aa56 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:34.053975 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-d88b5b58-1da5-4895-9611-cdfb4093aa56 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:34.119255 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-0322fc91-4f86-4beb-bc01-b52ab6dd5e18 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:34.127509 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-0322fc91-4f86-4beb-bc01-b52ab6dd5e18 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40" status: 200 len: 1735 microversion: 2.1 time: 0.156176 Jul 19 15:49:34.128075 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 274/602] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:49:33 2022] GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:49:34.132545 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-0f83a420-1718-4990-b65b-64191011edfd tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:34.133260 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-0f83a420-1718-4990-b65b-64191011edfd tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] [instance: 672d60bf-f3f3-41af-80a8-3843b33aad78] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:34.139170 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-0f83a420-1718-4990-b65b-64191011edfd tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:34.139623 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-0f83a420-1718-4990-b65b-64191011edfd tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:34.140381 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-0f83a420-1718-4990-b65b-64191011edfd tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:34.140819 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-0f83a420-1718-4990-b65b-64191011edfd tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:34.190582 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-d88b5b58-1da5-4895-9611-cdfb4093aa56 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7c42cf0bc84292bb0b7edb9f2e7fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a72d232f314a78b0e1c3f04b0ed682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:34.198055 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-d88b5b58-1da5-4895-9611-cdfb4093aa56 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/5f1579c0-907a-490f-ad8e-0fe2db0baf97" status: 200 len: 1681 microversion: 2.1 time: 0.156876 Jul 19 15:49:34.198653 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 329/603] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:49:34 2022] GET /compute/v2.1/servers/5f1579c0-907a-490f-ad8e-0fe2db0baf97 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:49:34.269898 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-0f83a420-1718-4990-b65b-64191011edfd tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf2b338eac47f6bcf20a48770b2e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41bf5203b925421b9dd2ccc5b7d40ad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:34.277523 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-0f83a420-1718-4990-b65b-64191011edfd tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] 10.222.0.64 "GET /compute/v2.1/servers/672d60bf-f3f3-41af-80a8-3843b33aad78" status: 200 len: 1513 microversion: 2.1 time: 0.148491 Jul 19 15:49:34.278088 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 275/604] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:49:34 2022] GET /compute/v2.1/servers/672d60bf-f3f3-41af-80a8-3843b33aad78 => generated 1513 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:49:34.472628 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-7005fff8-780d-4bd7-9927-35327e76324e tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:34.473119 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-7005fff8-780d-4bd7-9927-35327e76324e tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:34.479113 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-7005fff8-780d-4bd7-9927-35327e76324e tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:34.479555 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-7005fff8-780d-4bd7-9927-35327e76324e tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:34.480308 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-7005fff8-780d-4bd7-9927-35327e76324e tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:34.480740 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-7005fff8-780d-4bd7-9927-35327e76324e tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:34.509560 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-7005fff8-780d-4bd7-9927-35327e76324e tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b/os-volume_attachments/1067a5c6-39c8-46c6-b2e5-3d08ca2ec4ce" status: 200 len: 194 microversion: 2.20 time: 0.041258 Jul 19 15:49:34.510162 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 330/605] 10.222.0.64 () {60 vars in 1453 bytes} [Tue Jul 19 15:49:34 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b/os-volume_attachments/1067a5c6-39c8-46c6-b2e5-3d08ca2ec4ce => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 15:49:34.573937 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-6843132e-c95e-45c5-9e32-5d122e543121 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:34.574450 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-6843132e-c95e-45c5-9e32-5d122e543121 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:34.581702 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-6843132e-c95e-45c5-9e32-5d122e543121 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:34.582146 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-6843132e-c95e-45c5-9e32-5d122e543121 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:34.582956 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-6843132e-c95e-45c5-9e32-5d122e543121 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:34.583386 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-6843132e-c95e-45c5-9e32-5d122e543121 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:34.662464 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.objects.instance [None req-6843132e-c95e-45c5-9e32-5d122e543121 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lazy-loading 'services' on Instance uuid 3eeb4a51-a06c-4faf-9a63-bf3658ca773b {{(pid=129519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 15:49:34.738012 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-6843132e-c95e-45c5-9e32-5d122e543121 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "DELETE /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b/os-volume_attachments/1067a5c6-39c8-46c6-b2e5-3d08ca2ec4ce" status: 202 len: 0 microversion: 2.20 time: 0.167851 Jul 19 15:49:34.738638 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 276/606] 10.222.0.64 () {60 vars in 1456 bytes} [Tue Jul 19 15:49:34 2022] DELETE /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b/os-volume_attachments/1067a5c6-39c8-46c6-b2e5-3d08ca2ec4ce => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 19 15:49:34.747069 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-a56c4d0f-81a1-4b6e-a945-e089d68b5a9b tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:34.748065 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-a56c4d0f-81a1-4b6e-a945-e089d68b5a9b tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:34.755084 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-a56c4d0f-81a1-4b6e-a945-e089d68b5a9b tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:34.755536 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-a56c4d0f-81a1-4b6e-a945-e089d68b5a9b tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:34.756299 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-a56c4d0f-81a1-4b6e-a945-e089d68b5a9b tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:34.756742 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-a56c4d0f-81a1-4b6e-a945-e089d68b5a9b tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:34.785717 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-a56c4d0f-81a1-4b6e-a945-e089d68b5a9b tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042537 Jul 19 15:49:34.786194 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 331/607] 10.222.0.64 () {60 vars in 1342 bytes} [Tue Jul 19 15:49:34 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 15:49:35.145670 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-16a070f5-4272-47d5-a65e-42f87f6b58f9 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:35.146408 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-16a070f5-4272-47d5-a65e-42f87f6b58f9 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 0194ecf2-5e08-49b2-a4e9-185bf9b32e40] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:35.152727 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-16a070f5-4272-47d5-a65e-42f87f6b58f9 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:35.153165 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-16a070f5-4272-47d5-a65e-42f87f6b58f9 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:35.153919 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-16a070f5-4272-47d5-a65e-42f87f6b58f9 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:35.154345 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-16a070f5-4272-47d5-a65e-42f87f6b58f9 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:35.215995 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-e5926581-87cd-4fbb-9ebf-4ec545b5cbd3 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:35.216586 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-e5926581-87cd-4fbb-9ebf-4ec545b5cbd3 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: 5f1579c0-907a-490f-ad8e-0fe2db0baf97] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:35.223709 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-e5926581-87cd-4fbb-9ebf-4ec545b5cbd3 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:35.224159 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-e5926581-87cd-4fbb-9ebf-4ec545b5cbd3 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:35.224924 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-e5926581-87cd-4fbb-9ebf-4ec545b5cbd3 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:35.225362 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-e5926581-87cd-4fbb-9ebf-4ec545b5cbd3 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:35.319014 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-16a070f5-4272-47d5-a65e-42f87f6b58f9 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:35.327122 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-16a070f5-4272-47d5-a65e-42f87f6b58f9 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40" status: 200 len: 1735 microversion: 2.1 time: 0.186794 Jul 19 15:49:35.327799 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 277/608] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:49:35 2022] GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40 => generated 1735 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:49:35.332332 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-ca9ff2c7-a270-4b35-84f1-28dab1e00722 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:35.333010 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-ca9ff2c7-a270-4b35-84f1-28dab1e00722 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] [instance: 672d60bf-f3f3-41af-80a8-3843b33aad78] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:35.338857 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-ca9ff2c7-a270-4b35-84f1-28dab1e00722 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:35.339375 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-ca9ff2c7-a270-4b35-84f1-28dab1e00722 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:35.340203 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-ca9ff2c7-a270-4b35-84f1-28dab1e00722 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:35.340645 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-ca9ff2c7-a270-4b35-84f1-28dab1e00722 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:35.370275 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-e5926581-87cd-4fbb-9ebf-4ec545b5cbd3 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7c42cf0bc84292bb0b7edb9f2e7fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a72d232f314a78b0e1c3f04b0ed682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:35.378490 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-e5926581-87cd-4fbb-9ebf-4ec545b5cbd3 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/5f1579c0-907a-490f-ad8e-0fe2db0baf97" status: 200 len: 1681 microversion: 2.1 time: 0.166285 Jul 19 15:49:35.379066 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 332/609] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:49:35 2022] GET /compute/v2.1/servers/5f1579c0-907a-490f-ad8e-0fe2db0baf97 => generated 1681 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:49:35.474293 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-ca9ff2c7-a270-4b35-84f1-28dab1e00722 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf2b338eac47f6bcf20a48770b2e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41bf5203b925421b9dd2ccc5b7d40ad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:35.477819 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG dbcounter [-] [129519] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=129519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:49:35.482952 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-ca9ff2c7-a270-4b35-84f1-28dab1e00722 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] 10.222.0.64 "GET /compute/v2.1/servers/672d60bf-f3f3-41af-80a8-3843b33aad78" status: 200 len: 1513 microversion: 2.1 time: 0.154167 Jul 19 15:49:35.483514 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 278/610] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:49:35 2022] GET /compute/v2.1/servers/672d60bf-f3f3-41af-80a8-3843b33aad78 => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:49:35.797870 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-b9b08be4-4487-4e91-a100-82a6c1f06e82 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:35.799093 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-b9b08be4-4487-4e91-a100-82a6c1f06e82 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:35.805200 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b9b08be4-4487-4e91-a100-82a6c1f06e82 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:35.805746 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b9b08be4-4487-4e91-a100-82a6c1f06e82 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:35.806617 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b9b08be4-4487-4e91-a100-82a6c1f06e82 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:35.807123 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b9b08be4-4487-4e91-a100-82a6c1f06e82 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:35.836506 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-b9b08be4-4487-4e91-a100-82a6c1f06e82 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042778 Jul 19 15:49:35.837081 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 333/611] 10.222.0.64 () {60 vars in 1342 bytes} [Tue Jul 19 15:49:35 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 15:49:36.345728 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-7e03ff95-06de-4825-8eaf-88808ebb0318 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:36.346521 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-7e03ff95-06de-4825-8eaf-88808ebb0318 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 0194ecf2-5e08-49b2-a4e9-185bf9b32e40] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:36.354120 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-7e03ff95-06de-4825-8eaf-88808ebb0318 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:36.354598 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-7e03ff95-06de-4825-8eaf-88808ebb0318 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:36.355370 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-7e03ff95-06de-4825-8eaf-88808ebb0318 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:36.355805 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-7e03ff95-06de-4825-8eaf-88808ebb0318 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:36.397222 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-e7e3ae52-bd66-4c95-8f91-f00592a479fd tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:36.397913 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-e7e3ae52-bd66-4c95-8f91-f00592a479fd tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: 5f1579c0-907a-490f-ad8e-0fe2db0baf97] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:36.405226 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-e7e3ae52-bd66-4c95-8f91-f00592a479fd tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:36.405764 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-e7e3ae52-bd66-4c95-8f91-f00592a479fd tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:36.406727 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-e7e3ae52-bd66-4c95-8f91-f00592a479fd tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:36.407232 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-e7e3ae52-bd66-4c95-8f91-f00592a479fd tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:36.551616 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-e7e3ae52-bd66-4c95-8f91-f00592a479fd tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7c42cf0bc84292bb0b7edb9f2e7fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a72d232f314a78b0e1c3f04b0ed682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:36.559464 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-e7e3ae52-bd66-4c95-8f91-f00592a479fd tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/5f1579c0-907a-490f-ad8e-0fe2db0baf97" status: 200 len: 1681 microversion: 2.1 time: 0.167553 Jul 19 15:49:36.560041 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 334/612] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:49:36 2022] GET /compute/v2.1/servers/5f1579c0-907a-490f-ad8e-0fe2db0baf97 => generated 1681 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:49:36.565101 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-784e9e04-c058-49e8-9207-e4bc27b445c7 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:36.565708 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-784e9e04-c058-49e8-9207-e4bc27b445c7 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] [instance: 672d60bf-f3f3-41af-80a8-3843b33aad78] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:36.573170 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-784e9e04-c058-49e8-9207-e4bc27b445c7 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:36.574441 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-784e9e04-c058-49e8-9207-e4bc27b445c7 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:36.575244 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-784e9e04-c058-49e8-9207-e4bc27b445c7 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:36.575750 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-784e9e04-c058-49e8-9207-e4bc27b445c7 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:36.649769 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-784e9e04-c058-49e8-9207-e4bc27b445c7 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bf2b338eac47f6bcf20a48770b2e01', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41bf5203b925421b9dd2ccc5b7d40ad8', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:36.657947 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-7e03ff95-06de-4825-8eaf-88808ebb0318 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:36.666209 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-784e9e04-c058-49e8-9207-e4bc27b445c7 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] 10.222.0.64 "GET /compute/v2.1/servers/672d60bf-f3f3-41af-80a8-3843b33aad78" status: 200 len: 1471 microversion: 2.1 time: 0.104594 Jul 19 15:49:36.666959 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 335/613] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:49:36 2022] GET /compute/v2.1/servers/672d60bf-f3f3-41af-80a8-3843b33aad78 => generated 1471 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:49:36.667430 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-7e03ff95-06de-4825-8eaf-88808ebb0318 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40" status: 200 len: 1735 microversion: 2.1 time: 0.326729 Jul 19 15:49:36.673099 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [req-8f7d6212-ccc4-4f09-be01-92198b7c843d req-996ed0b0-790d-4fd6-b514-85785995c70f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "672d60bf-f3f3-41af-80a8-3843b33aad78", "name": "network-vif-deleted", "tag": "90fe63af-3f5b-4170-8459-f2ece9a2abde"}]} {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:49:36.677550 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 279/614] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:49:36 2022] GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40 => generated 1735 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:49:36.681315 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [req-8f7d6212-ccc4-4f09-be01-92198b7c843d req-996ed0b0-790d-4fd6-b514-85785995c70f service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:36.681889 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [req-8f7d6212-ccc4-4f09-be01-92198b7c843d req-996ed0b0-790d-4fd6-b514-85785995c70f service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:36.697571 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.compute.server_external_events [req-8f7d6212-ccc4-4f09-be01-92198b7c843d req-996ed0b0-790d-4fd6-b514-85785995c70f service nova] Creating event network-vif-deleted:90fe63af-3f5b-4170-8459-f2ece9a2abde for instance 672d60bf-f3f3-41af-80a8-3843b33aad78 on hv-cinder-84902 Jul 19 15:49:36.702530 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [req-8f7d6212-ccc4-4f09-be01-92198b7c843d req-996ed0b0-790d-4fd6-b514-85785995c70f service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034177 Jul 19 15:49:36.703105 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 336/615] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Jul 19 15:49:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:49:36.850446 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-a2cfc453-830f-4217-a62b-9385c2a1dc82 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:36.851457 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-a2cfc453-830f-4217-a62b-9385c2a1dc82 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:36.857458 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-a2cfc453-830f-4217-a62b-9385c2a1dc82 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:36.857911 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-a2cfc453-830f-4217-a62b-9385c2a1dc82 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:36.858749 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-a2cfc453-830f-4217-a62b-9385c2a1dc82 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:36.859192 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-a2cfc453-830f-4217-a62b-9385c2a1dc82 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:36.888400 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-a2cfc453-830f-4217-a62b-9385c2a1dc82 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042444 Jul 19 15:49:36.889197 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 280/616] 10.222.0.64 () {60 vars in 1342 bytes} [Tue Jul 19 15:49:36 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:49:36.955809 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-168b1299-8c8d-4952-94c4-a365257be329 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:36.956387 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-168b1299-8c8d-4952-94c4-a365257be329 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:36.962651 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-168b1299-8c8d-4952-94c4-a365257be329 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:36.963096 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-168b1299-8c8d-4952-94c4-a365257be329 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:36.963873 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-168b1299-8c8d-4952-94c4-a365257be329 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:36.964276 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-168b1299-8c8d-4952-94c4-a365257be329 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:36.990640 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-168b1299-8c8d-4952-94c4-a365257be329 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Going to try to terminate instance {{(pid=129520) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 15:49:36.992661 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG dbcounter [-] [129520] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:49:37.135054 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-168b1299-8c8d-4952-94c4-a365257be329 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "DELETE /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 204 len: 0 microversion: 2.20 time: 0.184860 Jul 19 15:49:37.136027 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 337/617] 10.222.0.64 () {60 vars in 1279 bytes} [Tue Jul 19 15:49:36 2022] DELETE /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 19 15:49:37.144835 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-b2bb0384-f978-4afe-a685-7a967abece8c tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:37.145448 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-b2bb0384-f978-4afe-a685-7a967abece8c tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:37.151965 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-b2bb0384-f978-4afe-a685-7a967abece8c tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:37.152695 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-b2bb0384-f978-4afe-a685-7a967abece8c tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:37.153629 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-b2bb0384-f978-4afe-a685-7a967abece8c tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:37.154213 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-b2bb0384-f978-4afe-a685-7a967abece8c tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:37.311964 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-b2bb0384-f978-4afe-a685-7a967abece8c tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:37.320526 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-b2bb0384-f978-4afe-a685-7a967abece8c tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:37.322117 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-b2bb0384-f978-4afe-a685-7a967abece8c tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:37.323307 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-b2bb0384-f978-4afe-a685-7a967abece8c tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 200 len: 1723 microversion: 2.20 time: 0.183174 Jul 19 15:49:37.323861 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 281/618] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:49:37 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 1723 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:49:37.577823 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-eba5f268-a71c-4447-9698-79b38811ed2c tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:37.578591 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-eba5f268-a71c-4447-9698-79b38811ed2c tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: 5f1579c0-907a-490f-ad8e-0fe2db0baf97] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:37.586566 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-eba5f268-a71c-4447-9698-79b38811ed2c tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:37.586929 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-eba5f268-a71c-4447-9698-79b38811ed2c tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:37.587713 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-eba5f268-a71c-4447-9698-79b38811ed2c tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:37.588150 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-eba5f268-a71c-4447-9698-79b38811ed2c tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:37.622015 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-eba5f268-a71c-4447-9698-79b38811ed2c tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:37.622659 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-eba5f268-a71c-4447-9698-79b38811ed2c tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:37.623108 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.objects.instance [None req-eba5f268-a71c-4447-9698-79b38811ed2c tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lazy-loading 'fault' on Instance uuid 5f1579c0-907a-490f-ad8e-0fe2db0baf97 {{(pid=129520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 15:49:37.670523 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-eba5f268-a71c-4447-9698-79b38811ed2c tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7c42cf0bc84292bb0b7edb9f2e7fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a72d232f314a78b0e1c3f04b0ed682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:37.678384 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-eba5f268-a71c-4447-9698-79b38811ed2c tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/5f1579c0-907a-490f-ad8e-0fe2db0baf97" status: 200 len: 1330 microversion: 2.1 time: 0.104777 Jul 19 15:49:37.678967 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 338/619] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:49:37 2022] GET /compute/v2.1/servers/5f1579c0-907a-490f-ad8e-0fe2db0baf97 => generated 1330 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:49:37.687278 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-7543c95b-af81-4afa-bd08-be5aaa76ea16 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:37.689336 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-7543c95b-af81-4afa-bd08-be5aaa76ea16 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] [instance: 672d60bf-f3f3-41af-80a8-3843b33aad78] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:37.692718 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-df986ea2-0965-4c4d-80b2-25228387d4e5 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:37.692718 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-df986ea2-0965-4c4d-80b2-25228387d4e5 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 0194ecf2-5e08-49b2-a4e9-185bf9b32e40] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:37.696067 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-7543c95b-af81-4afa-bd08-be5aaa76ea16 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:37.696605 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-7543c95b-af81-4afa-bd08-be5aaa76ea16 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:37.697451 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-7543c95b-af81-4afa-bd08-be5aaa76ea16 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:37.697960 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-7543c95b-af81-4afa-bd08-be5aaa76ea16 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:37.698515 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-df986ea2-0965-4c4d-80b2-25228387d4e5 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:37.698962 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-df986ea2-0965-4c4d-80b2-25228387d4e5 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:37.699720 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-df986ea2-0965-4c4d-80b2-25228387d4e5 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:37.700149 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-df986ea2-0965-4c4d-80b2-25228387d4e5 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:37.713334 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.wsgi [None req-7543c95b-af81-4afa-bd08-be5aaa76ea16 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] HTTP exception thrown: Instance 672d60bf-f3f3-41af-80a8-3843b33aad78 could not be found. Jul 19 15:49:37.715267 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-7543c95b-af81-4afa-bd08-be5aaa76ea16 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Request method failure captured: Jul 19 15:49:37.715267 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: request: GET /compute/v2.1/servers/672d60bf-f3f3-41af-80a8-3843b33aad78 HTTP/1.1 Jul 19 15:49:37.715267 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Accept: application/json Jul 19 15:49:37.715267 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Accept-Encoding: identity Jul 19 15:49:37.715267 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Connection: close Jul 19 15:49:37.715267 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Content-Length: 0 Jul 19 15:49:37.715267 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Content-Type: application/json Jul 19 15:49:37.715267 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Host: 10.222.0.64 Jul 19 15:49:37.715267 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Openstack-System-Scope: None Jul 19 15:49:37.715267 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: User-Agent: python-urllib3/1.26.9 Jul 19 15:49:37.715267 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Auth-Token: gAAAAABi1tISMpdp1gU_P4TI6CuSIDdDyNIrbbeKvH082I6JbOdv-3sRqvca4MS9VZPjvZp3151yiWkhyJS3GZlYvgakWR9klSLWjRMC8kWXugvSbd1ohxG0pV3xa1FyLl5OT-3_9imYA01Tkh0kAzAWXK69PJ5RBWF6hst67GQpLEYYymdKrxA Jul 19 15:49:37.715267 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Domain-Id: None Jul 19 15:49:37.715267 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Domain-Name: None Jul 19 15:49:37.715267 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Identity-Status: Confirmed Jul 19 15:49:37.715267 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Is-Admin-Project: True Jul 19 15:49:37.715267 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Domain-Id: default Jul 19 15:49:37.715267 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Domain-Name: Default Jul 19 15:49:37.715267 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Id: 41bf5203b925421b9dd2ccc5b7d40ad8 Jul 19 15:49:37.715267 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Name: tempest-VolumesSnapshotTestJSON-560979741 Jul 19 15:49:37.715267 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Role: member,reader Jul 19 15:49:37.715267 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Roles: member,reader Jul 19 15:49:37.716549 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_41bf5203b925421b9dd2ccc5b7d40ad8", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/41bf5203b925421b9dd2ccc5b7d40ad8"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/41bf5203b925421b9dd2ccc5b7d40ad8"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/41bf5203b925421b9dd2ccc5b7d40ad8"}]}] Jul 19 15:49:37.716549 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Tenant: tempest-VolumesSnapshotTestJSON-560979741 Jul 19 15:49:37.716549 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Tenant-Id: 41bf5203b925421b9dd2ccc5b7d40ad8 Jul 19 15:49:37.716549 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-560979741 Jul 19 15:49:37.716549 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User: tempest-VolumesSnapshotTestJSON-560979741-project Jul 19 15:49:37.716549 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Domain-Id: default Jul 19 15:49:37.716549 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Domain-Name: Default Jul 19 15:49:37.716549 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Id: 86bf2b338eac47f6bcf20a48770b2e01 Jul 19 15:49:37.716549 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Name: tempest-VolumesSnapshotTestJSON-560979741-project Jul 19 15:49:37.716549 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: method: > Jul 19 15:49:37.716549 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: exception: Instance 672d60bf-f3f3-41af-80a8-3843b33aad78 could not be found. Jul 19 15:49:37.716549 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: action_args: {'id': '672d60bf-f3f3-41af-80a8-3843b33aad78'} Jul 19 15:49:37.717274 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:49:37.717274 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:49:37.717274 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 15:49:37.717274 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 15:49:37.717274 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 15:49:37.717274 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 15:49:37.717274 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 15:49:37.717274 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 15:49:37.717274 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 15:49:37.717274 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 15:49:37.717274 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 672d60bf-f3f3-41af-80a8-3843b33aad78 could not be found. Jul 19 15:49:37.717274 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:49:37.717274 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:49:37.717274 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:49:37.717274 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:49:37.717274 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:49:37.717274 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:49:37.717274 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:49:37.717274 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:49:37.717274 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:49:37.718420 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:49:37.718420 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 15:49:37.718420 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 15:49:37.718420 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 15:49:37.718420 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 15:49:37.718420 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 15:49:37.718420 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 15:49:37.718420 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 672d60bf-f3f3-41af-80a8-3843b33aad78 could not be found. Jul 19 15:49:37.718420 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:49:37.718420 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:49:37.718420 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:49:37.718420 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:49:37.718420 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:49:37.718420 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:49:37.718420 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:49:37.718420 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:49:37.718420 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 672d60bf-f3f3-41af-80a8-3843b33aad78 could not be found. Jul 19 15:49:37.718420 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:49:37.728306 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-7543c95b-af81-4afa-bd08-be5aaa76ea16 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] Returning 404 to user: Instance 672d60bf-f3f3-41af-80a8-3843b33aad78 could not be found. {{(pid=129519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:49:37.728306 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-7543c95b-af81-4afa-bd08-be5aaa76ea16 tempest-VolumesSnapshotTestJSON-560979741 tempest-VolumesSnapshotTestJSON-560979741-project] 10.222.0.64 "GET /compute/v2.1/servers/672d60bf-f3f3-41af-80a8-3843b33aad78" status: 404 len: 111 microversion: 2.1 time: 0.035862 Jul 19 15:49:37.728306 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 282/620] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:49:37 2022] GET /compute/v2.1/servers/672d60bf-f3f3-41af-80a8-3843b33aad78 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 15:49:37.850694 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-df986ea2-0965-4c4d-80b2-25228387d4e5 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:37.858731 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-df986ea2-0965-4c4d-80b2-25228387d4e5 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40" status: 200 len: 1735 microversion: 2.1 time: 0.171275 Jul 19 15:49:37.859491 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 339/621] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:49:37 2022] GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40 => generated 1735 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:49:38.342617 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-ff98d82f-794d-469a-8592-58359138b5ac tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:38.343227 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-ff98d82f-794d-469a-8592-58359138b5ac tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:38.349264 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-ff98d82f-794d-469a-8592-58359138b5ac tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:38.349715 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-ff98d82f-794d-469a-8592-58359138b5ac tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:38.350500 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-ff98d82f-794d-469a-8592-58359138b5ac tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:38.350933 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-ff98d82f-794d-469a-8592-58359138b5ac tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:38.485290 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-ff98d82f-794d-469a-8592-58359138b5ac tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:38.493141 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-ff98d82f-794d-469a-8592-58359138b5ac tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:38.494655 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-ff98d82f-794d-469a-8592-58359138b5ac tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:38.495790 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-ff98d82f-794d-469a-8592-58359138b5ac tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 200 len: 1723 microversion: 2.20 time: 0.157178 Jul 19 15:49:38.496329 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 283/622] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:49:38 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:49:38.696252 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-5dda3591-16e7-41a8-bac0-5b3445a721ba tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:38.696859 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-5dda3591-16e7-41a8-bac0-5b3445a721ba tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: 5f1579c0-907a-490f-ad8e-0fe2db0baf97] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:38.703835 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-5dda3591-16e7-41a8-bac0-5b3445a721ba tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:38.704295 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-5dda3591-16e7-41a8-bac0-5b3445a721ba tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:38.705052 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-5dda3591-16e7-41a8-bac0-5b3445a721ba tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:38.705486 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-5dda3591-16e7-41a8-bac0-5b3445a721ba tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:38.727381 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [req-7178ba0a-0348-4845-a8cc-99de25cf58eb req-25cb2183-132f-4733-afa1-72d6be8c61d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5f1579c0-907a-490f-ad8e-0fe2db0baf97", "name": "network-vif-deleted", "tag": "c75827cb-3014-46a1-a3d9-1c24d0e5f8f7"}]} {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:49:38.736720 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [req-7178ba0a-0348-4845-a8cc-99de25cf58eb req-25cb2183-132f-4733-afa1-72d6be8c61d6 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:38.736916 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-5dda3591-16e7-41a8-bac0-5b3445a721ba tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:38.737160 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [req-7178ba0a-0348-4845-a8cc-99de25cf58eb req-25cb2183-132f-4733-afa1-72d6be8c61d6 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:38.737262 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-5dda3591-16e7-41a8-bac0-5b3445a721ba tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:38.737782 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.objects.instance [None req-5dda3591-16e7-41a8-bac0-5b3445a721ba tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lazy-loading 'fault' on Instance uuid 5f1579c0-907a-490f-ad8e-0fe2db0baf97 {{(pid=129520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 15:49:38.747721 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.compute.server_external_events [req-7178ba0a-0348-4845-a8cc-99de25cf58eb req-25cb2183-132f-4733-afa1-72d6be8c61d6 service nova] Creating event network-vif-deleted:c75827cb-3014-46a1-a3d9-1c24d0e5f8f7 for instance 5f1579c0-907a-490f-ad8e-0fe2db0baf97 on hv-cinder-84902 Jul 19 15:49:38.753374 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [req-7178ba0a-0348-4845-a8cc-99de25cf58eb req-25cb2183-132f-4733-afa1-72d6be8c61d6 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029507 Jul 19 15:49:38.753960 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 284/623] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Jul 19 15:49:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 15:49:38.779035 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-5dda3591-16e7-41a8-bac0-5b3445a721ba tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7c42cf0bc84292bb0b7edb9f2e7fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a72d232f314a78b0e1c3f04b0ed682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:38.786805 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-5dda3591-16e7-41a8-bac0-5b3445a721ba tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/5f1579c0-907a-490f-ad8e-0fe2db0baf97" status: 200 len: 1330 microversion: 2.1 time: 0.094462 Jul 19 15:49:38.787370 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 340/624] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:49:38 2022] GET /compute/v2.1/servers/5f1579c0-907a-490f-ad8e-0fe2db0baf97 => generated 1330 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:49:38.877625 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-7ebaba7a-23eb-4d9f-a579-78bb99722ac1 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:38.878308 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-7ebaba7a-23eb-4d9f-a579-78bb99722ac1 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 0194ecf2-5e08-49b2-a4e9-185bf9b32e40] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:38.884569 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-7ebaba7a-23eb-4d9f-a579-78bb99722ac1 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:38.885023 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-7ebaba7a-23eb-4d9f-a579-78bb99722ac1 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:38.885780 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-7ebaba7a-23eb-4d9f-a579-78bb99722ac1 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:38.886214 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-7ebaba7a-23eb-4d9f-a579-78bb99722ac1 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:39.020159 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-7ebaba7a-23eb-4d9f-a579-78bb99722ac1 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:39.030023 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-7ebaba7a-23eb-4d9f-a579-78bb99722ac1 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40" status: 200 len: 1735 microversion: 2.1 time: 0.156510 Jul 19 15:49:39.030661 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 285/625] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:49:38 2022] GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40 => generated 1735 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:49:39.514654 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-dd97e7cb-95e0-474e-9203-7852bc757212 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:39.515417 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-dd97e7cb-95e0-474e-9203-7852bc757212 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:39.522539 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-dd97e7cb-95e0-474e-9203-7852bc757212 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:39.523076 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-dd97e7cb-95e0-474e-9203-7852bc757212 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:39.523972 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-dd97e7cb-95e0-474e-9203-7852bc757212 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:39.524449 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-dd97e7cb-95e0-474e-9203-7852bc757212 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:39.661229 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-dd97e7cb-95e0-474e-9203-7852bc757212 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:39.672875 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-dd97e7cb-95e0-474e-9203-7852bc757212 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:39.672875 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-dd97e7cb-95e0-474e-9203-7852bc757212 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:39.674004 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-dd97e7cb-95e0-474e-9203-7852bc757212 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 200 len: 1723 microversion: 2.20 time: 0.163321 Jul 19 15:49:39.686442 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 341/626] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:49:39 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:49:39.804141 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-780245b8-7a41-4d2a-8f85-10314e29315f tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:39.804764 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-780245b8-7a41-4d2a-8f85-10314e29315f tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: 5f1579c0-907a-490f-ad8e-0fe2db0baf97] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:39.811535 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-780245b8-7a41-4d2a-8f85-10314e29315f tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:39.811989 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-780245b8-7a41-4d2a-8f85-10314e29315f tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:39.812761 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-780245b8-7a41-4d2a-8f85-10314e29315f tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:39.813720 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-780245b8-7a41-4d2a-8f85-10314e29315f tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:39.827143 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.wsgi [None req-780245b8-7a41-4d2a-8f85-10314e29315f tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] HTTP exception thrown: Instance 5f1579c0-907a-490f-ad8e-0fe2db0baf97 could not be found. Jul 19 15:49:39.829432 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-780245b8-7a41-4d2a-8f85-10314e29315f tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Request method failure captured: Jul 19 15:49:39.829432 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: request: GET /compute/v2.1/servers/5f1579c0-907a-490f-ad8e-0fe2db0baf97 HTTP/1.1 Jul 19 15:49:39.829432 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Accept: application/json Jul 19 15:49:39.829432 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Accept-Encoding: identity Jul 19 15:49:39.829432 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Connection: close Jul 19 15:49:39.829432 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Content-Length: 0 Jul 19 15:49:39.829432 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Content-Type: application/json Jul 19 15:49:39.829432 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Host: 10.222.0.64 Jul 19 15:49:39.829432 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Openstack-System-Scope: None Jul 19 15:49:39.829432 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: User-Agent: python-urllib3/1.26.9 Jul 19 15:49:39.829432 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Auth-Token: gAAAAABi1tGPtVnrBLo0yCDS-Fxp117KmoW30EOrAzeE-HWJZTaOLzmdVU7ilJLT24AK1cNZoT6hZsY9VJG83Xk6FPFrebHG3s54Fuj7pMRO-j7b_NklvH50XPBLW-GpDpGZ3ebrTqCiTKXUJEZA0zlfYPmMdreiVMLme-IYyDlHVZle_DtpLr0 Jul 19 15:49:39.829432 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Domain-Id: None Jul 19 15:49:39.829432 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Domain-Name: None Jul 19 15:49:39.829432 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Identity-Status: Confirmed Jul 19 15:49:39.829432 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Is-Admin-Project: True Jul 19 15:49:39.829432 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Domain-Id: default Jul 19 15:49:39.829432 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Domain-Name: Default Jul 19 15:49:39.829432 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Id: 45a72d232f314a78b0e1c3f04b0ed682 Jul 19 15:49:39.829432 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Name: tempest-AttachVolumeNegativeTest-1922780758 Jul 19 15:49:39.829432 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Role: member,reader Jul 19 15:49:39.829432 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Roles: member,reader Jul 19 15:49:39.831168 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_45a72d232f314a78b0e1c3f04b0ed682", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/45a72d232f314a78b0e1c3f04b0ed682"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/45a72d232f314a78b0e1c3f04b0ed682"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/45a72d232f314a78b0e1c3f04b0ed682"}]}] Jul 19 15:49:39.831168 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Tenant: tempest-AttachVolumeNegativeTest-1922780758 Jul 19 15:49:39.831168 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Tenant-Id: 45a72d232f314a78b0e1c3f04b0ed682 Jul 19 15:49:39.831168 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1922780758 Jul 19 15:49:39.831168 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User: tempest-AttachVolumeNegativeTest-1922780758-project Jul 19 15:49:39.831168 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Domain-Id: default Jul 19 15:49:39.831168 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Domain-Name: Default Jul 19 15:49:39.831168 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Id: 2d7c42cf0bc84292bb0b7edb9f2e7fc3 Jul 19 15:49:39.831168 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Name: tempest-AttachVolumeNegativeTest-1922780758-project Jul 19 15:49:39.831168 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: method: > Jul 19 15:49:39.831168 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: exception: Instance 5f1579c0-907a-490f-ad8e-0fe2db0baf97 could not be found. Jul 19 15:49:39.831168 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: action_args: {'id': '5f1579c0-907a-490f-ad8e-0fe2db0baf97'} Jul 19 15:49:39.831884 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:49:39.831884 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:49:39.831884 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 15:49:39.831884 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 15:49:39.831884 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 15:49:39.831884 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 15:49:39.831884 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 15:49:39.831884 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 15:49:39.831884 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 15:49:39.831884 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 15:49:39.831884 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f1579c0-907a-490f-ad8e-0fe2db0baf97 could not be found. Jul 19 15:49:39.831884 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:49:39.831884 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:49:39.831884 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:49:39.831884 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:49:39.831884 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:49:39.831884 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:49:39.831884 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:49:39.831884 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:49:39.831884 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:49:39.833038 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:49:39.833038 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 15:49:39.833038 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 15:49:39.833038 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 15:49:39.833038 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 15:49:39.833038 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 15:49:39.833038 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 15:49:39.833038 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f1579c0-907a-490f-ad8e-0fe2db0baf97 could not be found. Jul 19 15:49:39.833038 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:49:39.833038 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:49:39.833038 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:49:39.833038 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:49:39.833038 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:49:39.833038 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:49:39.833038 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:49:39.833038 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:49:39.833038 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f1579c0-907a-490f-ad8e-0fe2db0baf97 could not be found. Jul 19 15:49:39.833038 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:49:39.834056 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-780245b8-7a41-4d2a-8f85-10314e29315f tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Returning 404 to user: Instance 5f1579c0-907a-490f-ad8e-0fe2db0baf97 could not be found. {{(pid=129519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:49:39.834056 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-780245b8-7a41-4d2a-8f85-10314e29315f tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/5f1579c0-907a-490f-ad8e-0fe2db0baf97" status: 404 len: 111 microversion: 2.1 time: 0.030833 Jul 19 15:49:39.834056 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 286/627] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:49:39 2022] GET /compute/v2.1/servers/5f1579c0-907a-490f-ad8e-0fe2db0baf97 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 15:49:39.839859 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-e5c33f92-6bb9-458e-9a08-1bfc154e99da tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '.version_select at 0x7fb8a5aa7430>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:39.857427 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-e5c33f92-6bb9-458e-9a08-1bfc154e99da tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-697233227" status: 202 len: 0 microversion: 2.1 time: 0.021411 Jul 19 15:49:39.858233 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 342/628] 10.222.0.64 () {58 vars in 1217 bytes} [Tue Jul 19 15:49:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-697233227 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 15:49:40.048589 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-b0cbdde3-4d08-4737-ab9d-496b077f77a6 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:40.049233 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-b0cbdde3-4d08-4737-ab9d-496b077f77a6 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 0194ecf2-5e08-49b2-a4e9-185bf9b32e40] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:40.064093 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-b0cbdde3-4d08-4737-ab9d-496b077f77a6 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:40.064535 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-b0cbdde3-4d08-4737-ab9d-496b077f77a6 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:40.065951 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-b0cbdde3-4d08-4737-ab9d-496b077f77a6 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:40.066417 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-b0cbdde3-4d08-4737-ab9d-496b077f77a6 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:40.320884 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-b0cbdde3-4d08-4737-ab9d-496b077f77a6 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:40.330351 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-b0cbdde3-4d08-4737-ab9d-496b077f77a6 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40" status: 200 len: 1735 microversion: 2.1 time: 0.285872 Jul 19 15:49:40.330961 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 287/629] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:49:40 2022] GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40 => generated 1735 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:49:40.613844 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-4d395309-9fcb-419a-a7df-004be166e5ca tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Action: 'create', calling method: .version_select at 0x7fb8a5b89820>, body: {"keypair": {"name": "tempest-keypair-582431366", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBidwKTn/ydW/Ten6ExpdUphBwCuniznUhmx0Tzh+pKDxYWuo6GaS2REy8SJAzsliqjimfavqL71v3LTuY0zZdYqPw5+U067CzPSoxXwnfNUjIB0qMNZKGnGWsx54cdmJw=="}} {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:49:40.628698 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.quota [None req-4d395309-9fcb-419a-a7df-004be166e5ca tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Getting quotas for project 45a72d232f314a78b0e1c3f04b0ed682. Resources: {'key_pairs'} {{(pid=129520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 15:49:40.633700 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.quota [None req-4d395309-9fcb-419a-a7df-004be166e5ca tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Getting quotas for user 2d7c42cf0bc84292bb0b7edb9f2e7fc3 and project 45a72d232f314a78b0e1c3f04b0ed682. Resources: {'key_pairs'} {{(pid=129520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 15:49:40.656324 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-4d395309-9fcb-419a-a7df-004be166e5ca tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.046410 Jul 19 15:49:40.657652 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 343/630] 10.222.0.64 () {60 vars in 1158 bytes} [Tue Jul 19 15:49:40 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:49:40.693278 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-f57de1b0-c93c-4922-91e9-c93507346e6b tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:40.693882 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-f57de1b0-c93c-4922-91e9-c93507346e6b tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:40.700130 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-f57de1b0-c93c-4922-91e9-c93507346e6b tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:40.700594 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-f57de1b0-c93c-4922-91e9-c93507346e6b tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:40.701315 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-f57de1b0-c93c-4922-91e9-c93507346e6b tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:40.701761 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-f57de1b0-c93c-4922-91e9-c93507346e6b tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:40.775747 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [req-18a87939-e823-4d47-ace3-ea40814b2291 req-e94aee81-336a-4621-85aa-b72db2a80a43 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3eeb4a51-a06c-4faf-9a63-bf3658ca773b", "name": "network-vif-deleted", "tag": "61483d93-6fa5-46d1-b820-a274f98ffcbb"}]} {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:49:40.785181 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [req-18a87939-e823-4d47-ace3-ea40814b2291 req-e94aee81-336a-4621-85aa-b72db2a80a43 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:40.785917 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [req-18a87939-e823-4d47-ace3-ea40814b2291 req-e94aee81-336a-4621-85aa-b72db2a80a43 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:40.793594 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-f57de1b0-c93c-4922-91e9-c93507346e6b tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:40.798898 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.compute.server_external_events [req-18a87939-e823-4d47-ace3-ea40814b2291 req-e94aee81-336a-4621-85aa-b72db2a80a43 service nova] Creating event network-vif-deleted:61483d93-6fa5-46d1-b820-a274f98ffcbb for instance 3eeb4a51-a06c-4faf-9a63-bf3658ca773b on hv-cinder-84902 Jul 19 15:49:40.804274 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [req-18a87939-e823-4d47-ace3-ea40814b2291 req-e94aee81-336a-4621-85aa-b72db2a80a43 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035613 Jul 19 15:49:40.805242 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 344/631] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Jul 19 15:49:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 15:49:40.805395 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-f57de1b0-c93c-4922-91e9-c93507346e6b tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:40.806931 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-f57de1b0-c93c-4922-91e9-c93507346e6b tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:40.808256 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-f57de1b0-c93c-4922-91e9-c93507346e6b tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 200 len: 1367 microversion: 2.20 time: 0.118870 Jul 19 15:49:40.808600 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 288/632] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:49:40 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 1367 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:49:41.349239 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-4d3496e2-299f-49d9-80f9-5662626d71b8 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:41.349949 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-4d3496e2-299f-49d9-80f9-5662626d71b8 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 0194ecf2-5e08-49b2-a4e9-185bf9b32e40] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:41.356461 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-4d3496e2-299f-49d9-80f9-5662626d71b8 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:41.356907 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-4d3496e2-299f-49d9-80f9-5662626d71b8 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:41.357705 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-4d3496e2-299f-49d9-80f9-5662626d71b8 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:41.358334 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-4d3496e2-299f-49d9-80f9-5662626d71b8 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:41.549720 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-4d3496e2-299f-49d9-80f9-5662626d71b8 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:41.558158 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-4d3496e2-299f-49d9-80f9-5662626d71b8 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40" status: 200 len: 1735 microversion: 2.1 time: 0.214037 Jul 19 15:49:41.558768 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 345/633] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:49:41 2022] GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40 => generated 1735 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:49:41.825771 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-e6abadbf-95ef-4e4b-b190-272b08e5be7a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:41.826518 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-e6abadbf-95ef-4e4b-b190-272b08e5be7a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:41.833519 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-e6abadbf-95ef-4e4b-b190-272b08e5be7a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:41.834091 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-e6abadbf-95ef-4e4b-b190-272b08e5be7a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:41.834940 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-e6abadbf-95ef-4e4b-b190-272b08e5be7a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:41.835313 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-e6abadbf-95ef-4e4b-b190-272b08e5be7a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:41.897476 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-e6abadbf-95ef-4e4b-b190-272b08e5be7a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:41.905746 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-e6abadbf-95ef-4e4b-b190-272b08e5be7a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:41.907803 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-e6abadbf-95ef-4e4b-b190-272b08e5be7a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:41.908920 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-e6abadbf-95ef-4e4b-b190-272b08e5be7a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 200 len: 1367 microversion: 2.20 time: 0.087086 Jul 19 15:49:41.909473 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 289/634] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:49:41 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 1367 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:49:42.090400 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-0598b3e5-22ad-4d37-bb71-9e1d8bff66e8 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-785541839", "imageRef": "15012099-fe38-45ac-bd33-d884a5ba65f2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fe8b95ad-7997-4bfd-893e-d87b2c843602"}], "security_groups": [{"name": "tempest-securitygroup--2061623943"}], "key_name": "tempest-keypair-582431366", "user_data": "}} {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:49:42.097948 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG dbcounter [-] [129520] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=3,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=129520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:49:42.207250 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.network.neutron [None req-0598b3e5-22ad-4d37-bb71-9e1d8bff66e8 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] validate_networks() for [('fe8b95ad-7997-4bfd-893e-d87b2c843602', None, None, None, None, None)] {{(pid=129520) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 15:49:42.576271 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-9b7baf64-10f3-4014-882e-cfb3ab1361a1 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:42.577178 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-9b7baf64-10f3-4014-882e-cfb3ab1361a1 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 0194ecf2-5e08-49b2-a4e9-185bf9b32e40] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:42.584159 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-9b7baf64-10f3-4014-882e-cfb3ab1361a1 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:42.584755 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-9b7baf64-10f3-4014-882e-cfb3ab1361a1 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:42.585530 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-9b7baf64-10f3-4014-882e-cfb3ab1361a1 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:42.585962 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-9b7baf64-10f3-4014-882e-cfb3ab1361a1 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:42.599222 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.virt.hardware [None req-0598b3e5-22ad-4d37-bb71-9e1d8bff66e8 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Flavor limits 0:0:0 {{(pid=129520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 15:49:42.599768 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.virt.hardware [None req-0598b3e5-22ad-4d37-bb71-9e1d8bff66e8 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Image limits 0:0:0 {{(pid=129520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 15:49:42.600088 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.virt.hardware [None req-0598b3e5-22ad-4d37-bb71-9e1d8bff66e8 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Flavor pref 0:0:0 {{(pid=129520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 15:49:42.600604 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.virt.hardware [None req-0598b3e5-22ad-4d37-bb71-9e1d8bff66e8 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Image pref 0:0:0 {{(pid=129520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 15:49:42.601173 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.virt.hardware [None req-0598b3e5-22ad-4d37-bb71-9e1d8bff66e8 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 15:49:42.613629 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-0598b3e5-22ad-4d37-bb71-9e1d8bff66e8 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:42.614337 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-0598b3e5-22ad-4d37-bb71-9e1d8bff66e8 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:42.615634 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-0598b3e5-22ad-4d37-bb71-9e1d8bff66e8 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:42.616226 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-0598b3e5-22ad-4d37-bb71-9e1d8bff66e8 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:42.657131 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.quota [None req-0598b3e5-22ad-4d37-bb71-9e1d8bff66e8 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Getting quotas for project 45a72d232f314a78b0e1c3f04b0ed682. Resources: {'ram', 'instances', 'cores'} {{(pid=129520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 15:49:42.662170 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.quota [None req-0598b3e5-22ad-4d37-bb71-9e1d8bff66e8 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Getting quotas for user 2d7c42cf0bc84292bb0b7edb9f2e7fc3 and project 45a72d232f314a78b0e1c3f04b0ed682. Resources: {'ram', 'instances', 'cores'} {{(pid=129520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 15:49:42.686560 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-0598b3e5-22ad-4d37-bb71-9e1d8bff66e8 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Going to run 1 instances... {{(pid=129520) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 15:49:42.690451 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-0598b3e5-22ad-4d37-bb71-9e1d8bff66e8 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: d1382aa7-6d93-410a-94ae-a7944114573f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='15012099-fe38-45ac-bd33-d884a5ba65f2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 15:49:42.756912 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-0598b3e5-22ad-4d37-bb71-9e1d8bff66e8 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.673051 Jul 19 15:49:42.757975 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 346/635] 10.222.0.64 () {60 vars in 1146 bytes} [Tue Jul 19 15:49:42 2022] POST /compute/v2.1/servers => generated 402 bytes in 675 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 15:49:42.768234 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-a4965b78-e044-460e-ab5e-49866406783c tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:42.769139 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-a4965b78-e044-460e-ab5e-49866406783c tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: d1382aa7-6d93-410a-94ae-a7944114573f] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:42.800859 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-9b7baf64-10f3-4014-882e-cfb3ab1361a1 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:42.810724 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-9b7baf64-10f3-4014-882e-cfb3ab1361a1 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40" status: 200 len: 1735 microversion: 2.1 time: 0.238515 Jul 19 15:49:42.811589 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 290/636] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:49:42 2022] GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40 => generated 1735 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:49:42.830908 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-a4965b78-e044-460e-ab5e-49866406783c tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7c42cf0bc84292bb0b7edb9f2e7fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a72d232f314a78b0e1c3f04b0ed682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:42.838276 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-a4965b78-e044-460e-ab5e-49866406783c tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/d1382aa7-6d93-410a-94ae-a7944114573f" status: 200 len: 1240 microversion: 2.1 time: 0.074069 Jul 19 15:49:42.838876 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 347/637] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:49:42 2022] GET /compute/v2.1/servers/d1382aa7-6d93-410a-94ae-a7944114573f => generated 1240 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:49:42.927989 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-51bf9c0a-d052-453e-b70b-4667e499f84c tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:42.928544 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-51bf9c0a-d052-453e-b70b-4667e499f84c tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:42.934983 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-51bf9c0a-d052-453e-b70b-4667e499f84c tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:42.935432 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-51bf9c0a-d052-453e-b70b-4667e499f84c tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:42.936192 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-51bf9c0a-d052-453e-b70b-4667e499f84c tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:42.936624 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-51bf9c0a-d052-453e-b70b-4667e499f84c tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:42.950697 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.wsgi [None req-51bf9c0a-d052-453e-b70b-4667e499f84c tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] HTTP exception thrown: Instance 3eeb4a51-a06c-4faf-9a63-bf3658ca773b could not be found. Jul 19 15:49:42.952261 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-51bf9c0a-d052-453e-b70b-4667e499f84c tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Request method failure captured: Jul 19 15:49:42.952261 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: request: GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b HTTP/1.1 Jul 19 15:49:42.952261 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Accept: application/json Jul 19 15:49:42.952261 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Accept-Encoding: identity Jul 19 15:49:42.952261 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Connection: close Jul 19 15:49:42.952261 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Content-Length: 0 Jul 19 15:49:42.952261 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Content-Type: application/json Jul 19 15:49:42.952261 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Host: 10.222.0.64 Jul 19 15:49:42.952261 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Openstack-System-Scope: None Jul 19 15:49:42.952261 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: User-Agent: python-urllib3/1.26.9 Jul 19 15:49:42.952261 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Auth-Token: gAAAAABi1tGHQ64QBmv4eGgDad1tR5ylzAiZZRMu8S6JEwmmkw0ws4HuMMi_Srl4E3pmdtmusBCj_7F5cD4cGFGiBY5Gg_tG6GXGKe9b6oGy4QHTRNfOPH-xklO2Xd8kIUmNbMKwMVBU2CQWnx3dEeh2vQgUtexBibzvdAzao6A_j97Z_skRgQA Jul 19 15:49:42.952261 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Domain-Id: None Jul 19 15:49:42.952261 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Domain-Name: None Jul 19 15:49:42.952261 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Identity-Status: Confirmed Jul 19 15:49:42.952261 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Is-Admin-Project: True Jul 19 15:49:42.952261 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Openstack-Nova-Api-Version: 2.20 Jul 19 15:49:42.952261 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Domain-Id: default Jul 19 15:49:42.952261 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Domain-Name: Default Jul 19 15:49:42.952261 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Id: 171a2f5462994c8d98ffd8cbc2ce5677 Jul 19 15:49:42.952261 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1314265819 Jul 19 15:49:42.952261 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Role: member,reader Jul 19 15:49:42.952261 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Roles: member,reader Jul 19 15:49:42.954432 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_171a2f5462994c8d98ffd8cbc2ce5677", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/171a2f5462994c8d98ffd8cbc2ce5677"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/171a2f5462994c8d98ffd8cbc2ce5677"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/171a2f5462994c8d98ffd8cbc2ce5677"}]}] Jul 19 15:49:42.954432 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1314265819 Jul 19 15:49:42.954432 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Tenant-Id: 171a2f5462994c8d98ffd8cbc2ce5677 Jul 19 15:49:42.954432 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1314265819 Jul 19 15:49:42.954432 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User: tempest-AttachVolumeShelveTestJSON-1314265819-project Jul 19 15:49:42.954432 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Domain-Id: default Jul 19 15:49:42.954432 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Domain-Name: Default Jul 19 15:49:42.954432 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Id: fca86639f2d344be97cb1529dc17f62a Jul 19 15:49:42.954432 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1314265819-project Jul 19 15:49:42.954432 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: method: > Jul 19 15:49:42.954432 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: exception: Instance 3eeb4a51-a06c-4faf-9a63-bf3658ca773b could not be found. Jul 19 15:49:42.954432 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: action_args: {'id': '3eeb4a51-a06c-4faf-9a63-bf3658ca773b'} Jul 19 15:49:42.955367 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:49:42.955367 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:49:42.955367 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 15:49:42.955367 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 15:49:42.955367 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 15:49:42.955367 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 15:49:42.955367 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 15:49:42.955367 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 15:49:42.955367 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 15:49:42.955367 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 15:49:42.955367 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3eeb4a51-a06c-4faf-9a63-bf3658ca773b could not be found. Jul 19 15:49:42.955367 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:49:42.955367 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:49:42.955367 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:49:42.955367 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:49:42.955367 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:49:42.955367 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:49:42.955367 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:49:42.955367 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:49:42.955367 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:49:42.956590 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:49:42.956590 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 15:49:42.956590 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 15:49:42.956590 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 15:49:42.956590 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 15:49:42.956590 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 15:49:42.956590 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 15:49:42.956590 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3eeb4a51-a06c-4faf-9a63-bf3658ca773b could not be found. Jul 19 15:49:42.956590 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:49:42.956590 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:49:42.956590 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:49:42.956590 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:49:42.956590 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:49:42.956590 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:49:42.956590 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:49:42.956590 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:49:42.956590 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3eeb4a51-a06c-4faf-9a63-bf3658ca773b could not be found. Jul 19 15:49:42.956590 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:49:42.959861 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-51bf9c0a-d052-453e-b70b-4667e499f84c tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Returning 404 to user: Instance 3eeb4a51-a06c-4faf-9a63-bf3658ca773b could not be found. {{(pid=129519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:49:42.959861 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-51bf9c0a-d052-453e-b70b-4667e499f84c tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 404 len: 111 microversion: 2.20 time: 0.029594 Jul 19 15:49:42.959861 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 291/638] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:49:42 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 19 15:49:42.964554 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-b7718ebf-3e05-4709-a528-77bab11fe855 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '.version_select at 0x7fb8a5b89b80>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:42.984245 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-b7718ebf-3e05-4709-a528-77bab11fe855 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1637844085" status: 204 len: 0 microversion: 2.20 time: 0.023872 Jul 19 15:49:42.984886 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 348/639] 10.222.0.64 () {60 vars in 1261 bytes} [Tue Jul 19 15:49:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1637844085 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 19 15:49:43.646250 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-742e7690-5ea7-4bbd-b1bf-a2eaa890f291 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Action: 'create', calling method: .version_select at 0x7fb8a5b193a0>, body: {"keypair": {"name": "tempest-keypair-2037912774", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFNpR2Lxx32wCkhX87Eq4B+fwkcY2hWAdB3KPJtA/VEhodX3dw1S74/AdQKyc3yDT6r3CY1dYuXcJocA26Rcvm2486+8uhkwkOygiT4x4i3n87XxpFkPduuOtBjRj+GpzQ=="}} {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:49:43.662241 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.quota [None req-742e7690-5ea7-4bbd-b1bf-a2eaa890f291 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Getting quotas for project 171a2f5462994c8d98ffd8cbc2ce5677. Resources: {'key_pairs'} {{(pid=129519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 15:49:43.667002 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.quota [None req-742e7690-5ea7-4bbd-b1bf-a2eaa890f291 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Getting quotas for user fca86639f2d344be97cb1529dc17f62a and project 171a2f5462994c8d98ffd8cbc2ce5677. Resources: {'key_pairs'} {{(pid=129519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 15:49:43.708524 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-742e7690-5ea7-4bbd-b1bf-a2eaa890f291 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.066232 Jul 19 15:49:43.709377 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 292/640] 10.222.0.64 () {62 vars in 1199 bytes} [Tue Jul 19 15:49:43 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 68 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 19 15:49:43.830839 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-30b25639-9b68-4507-b07b-ae398b98d86f tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:43.831733 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-30b25639-9b68-4507-b07b-ae398b98d86f tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 0194ecf2-5e08-49b2-a4e9-185bf9b32e40] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:43.840160 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-30b25639-9b68-4507-b07b-ae398b98d86f tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:43.842570 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-30b25639-9b68-4507-b07b-ae398b98d86f tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:43.843433 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-30b25639-9b68-4507-b07b-ae398b98d86f tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:43.843975 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-30b25639-9b68-4507-b07b-ae398b98d86f tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:43.858857 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-ba19b19e-aadc-496d-860b-230f836895b8 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:43.860240 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-ba19b19e-aadc-496d-860b-230f836895b8 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: d1382aa7-6d93-410a-94ae-a7944114573f] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:43.869592 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-ba19b19e-aadc-496d-860b-230f836895b8 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:43.870395 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-ba19b19e-aadc-496d-860b-230f836895b8 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:43.871872 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-ba19b19e-aadc-496d-860b-230f836895b8 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:43.872474 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-ba19b19e-aadc-496d-860b-230f836895b8 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:43.969930 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-ba19b19e-aadc-496d-860b-230f836895b8 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7c42cf0bc84292bb0b7edb9f2e7fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a72d232f314a78b0e1c3f04b0ed682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:43.978648 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-ba19b19e-aadc-496d-860b-230f836895b8 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/d1382aa7-6d93-410a-94ae-a7944114573f" status: 200 len: 1298 microversion: 2.1 time: 0.125967 Jul 19 15:49:43.979468 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 293/641] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:49:43 2022] GET /compute/v2.1/servers/d1382aa7-6d93-410a-94ae-a7944114573f => generated 1298 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:49:44.079021 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-30b25639-9b68-4507-b07b-ae398b98d86f tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:44.091395 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-30b25639-9b68-4507-b07b-ae398b98d86f tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40" status: 200 len: 1735 microversion: 2.1 time: 0.264754 Jul 19 15:49:44.092157 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 349/642] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:49:43 2022] GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40 => generated 1735 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:49:44.415222 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-477ab3a4-868b-49fa-b616-0865b9e60ae4 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:44.416112 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-477ab3a4-868b-49fa-b616-0865b9e60ae4 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 343ae383-5bfd-4c70-8926-a800fcee3519] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:44.423186 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-477ab3a4-868b-49fa-b616-0865b9e60ae4 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:44.423992 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-477ab3a4-868b-49fa-b616-0865b9e60ae4 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:44.424860 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-477ab3a4-868b-49fa-b616-0865b9e60ae4 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:44.425389 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-477ab3a4-868b-49fa-b616-0865b9e60ae4 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:44.522140 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.objects.instance [None req-477ab3a4-868b-49fa-b616-0865b9e60ae4 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lazy-loading 'services' on Instance uuid 343ae383-5bfd-4c70-8926-a800fcee3519 {{(pid=129519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 15:49:44.659661 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-477ab3a4-868b-49fa-b616-0865b9e60ae4 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "DELETE /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519/os-volume_attachments/68b2044b-bc1a-4502-8827-2b996b18515f" status: 202 len: 0 microversion: 2.1 time: 0.248348 Jul 19 15:49:44.660229 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 294/643] 10.222.0.64 () {58 vars in 1415 bytes} [Tue Jul 19 15:49:44 2022] DELETE /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519/os-volume_attachments/68b2044b-bc1a-4502-8827-2b996b18515f => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 15:49:44.997513 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-e18b9234-6604-412c-80f5-a47da920e749 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:44.999123 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-e18b9234-6604-412c-80f5-a47da920e749 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: d1382aa7-6d93-410a-94ae-a7944114573f] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:45.006865 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-e18b9234-6604-412c-80f5-a47da920e749 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:45.007810 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-e18b9234-6604-412c-80f5-a47da920e749 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:45.008904 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-e18b9234-6604-412c-80f5-a47da920e749 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:45.009593 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-e18b9234-6604-412c-80f5-a47da920e749 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:45.112103 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-95716fef-1f32-4733-8801-c3e81c9dad3c tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:45.112943 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-95716fef-1f32-4733-8801-c3e81c9dad3c tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 0194ecf2-5e08-49b2-a4e9-185bf9b32e40] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:45.122794 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-95716fef-1f32-4733-8801-c3e81c9dad3c tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:45.123538 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-95716fef-1f32-4733-8801-c3e81c9dad3c tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:45.125055 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-95716fef-1f32-4733-8801-c3e81c9dad3c tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:45.126554 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-95716fef-1f32-4733-8801-c3e81c9dad3c tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:45.288026 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-e18b9234-6604-412c-80f5-a47da920e749 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7c42cf0bc84292bb0b7edb9f2e7fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a72d232f314a78b0e1c3f04b0ed682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:45.300052 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-e18b9234-6604-412c-80f5-a47da920e749 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/d1382aa7-6d93-410a-94ae-a7944114573f" status: 200 len: 1366 microversion: 2.1 time: 0.306783 Jul 19 15:49:45.300923 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 350/644] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:49:44 2022] GET /compute/v2.1/servers/d1382aa7-6d93-410a-94ae-a7944114573f => generated 1366 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:49:45.440721 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-95716fef-1f32-4733-8801-c3e81c9dad3c tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:45.457773 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-95716fef-1f32-4733-8801-c3e81c9dad3c tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40" status: 200 len: 1735 microversion: 2.1 time: 0.352325 Jul 19 15:49:45.471376 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 295/645] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:49:45 2022] GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40 => generated 1735 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:49:45.805228 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [req-b5b48f93-03a4-4204-8732-71fdf009e27b req-cbec149c-07e5-4d9b-ac8c-9e452022f177 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1382aa7-6d93-410a-94ae-a7944114573f", "tag": "baf9abd3-9c5d-45c3-81b3-843072591796"}]} {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:49:45.831269 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [req-b5b48f93-03a4-4204-8732-71fdf009e27b req-cbec149c-07e5-4d9b-ac8c-9e452022f177 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:45.831844 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [req-b5b48f93-03a4-4204-8732-71fdf009e27b req-cbec149c-07e5-4d9b-ac8c-9e452022f177 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:45.846285 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.compute.server_external_events [req-b5b48f93-03a4-4204-8732-71fdf009e27b req-cbec149c-07e5-4d9b-ac8c-9e452022f177 service nova] Creating event network-changed:baf9abd3-9c5d-45c3-81b3-843072591796 for instance d1382aa7-6d93-410a-94ae-a7944114573f on hv-cinder-84902 Jul 19 15:49:45.852111 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [req-b5b48f93-03a4-4204-8732-71fdf009e27b req-cbec149c-07e5-4d9b-ac8c-9e452022f177 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059450 Jul 19 15:49:45.853032 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 351/646] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Jul 19 15:49:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:49:45.881256 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-8137209e-cbcc-44a9-8a05-7c030542d352 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:49:45.889597 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-8137209e-cbcc-44a9-8a05-7c030542d352 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:45.889976 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-8137209e-cbcc-44a9-8a05-7c030542d352 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:45.916872 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-8137209e-cbcc-44a9-8a05-7c030542d352 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 343ae383-5bfd-4c70-8926-a800fcee3519] Going to try to stop instance {{(pid=129519) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 19 15:49:45.948215 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-a890c6b6-8a8d-4508-bfa7-40603fa6bf0a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1144281148", "imageRef": "15012099-fe38-45ac-bd33-d884a5ba65f2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4747c92b-9953-4013-87b5-ea57492dd5d4"}], "security_groups": [{"name": "tempest-securitygroup--1486041827"}], "key_name": "tempest-keypair-2037912774", "user_data": "}} {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:49:45.987519 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-8137209e-cbcc-44a9-8a05-7c030542d352 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "POST /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519/action" status: 202 len: 0 microversion: 2.1 time: 0.112617 Jul 19 15:49:45.988130 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 296/647] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Jul 19 15:49:45 2022] POST /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 15:49:46.003767 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-b0e20736-8d5c-4612-b210-de417a6c8469 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:46.005080 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-b0e20736-8d5c-4612-b210-de417a6c8469 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 343ae383-5bfd-4c70-8926-a800fcee3519] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:46.012655 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-b0e20736-8d5c-4612-b210-de417a6c8469 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:46.013106 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-b0e20736-8d5c-4612-b210-de417a6c8469 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:46.014276 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-b0e20736-8d5c-4612-b210-de417a6c8469 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:46.015172 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-b0e20736-8d5c-4612-b210-de417a6c8469 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:46.038054 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG dbcounter [-] [129519] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=129519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:49:46.081902 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.network.neutron [None req-a890c6b6-8a8d-4508-bfa7-40603fa6bf0a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] validate_networks() for [('4747c92b-9953-4013-87b5-ea57492dd5d4', None, None, None, None, None)] {{(pid=129520) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 15:49:46.245917 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-b0e20736-8d5c-4612-b210-de417a6c8469 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c75043813844d79fd0764132dfe4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e234f713b40cd8772372c2316dd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:46.255251 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-b0e20736-8d5c-4612-b210-de417a6c8469 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519" status: 200 len: 1678 microversion: 2.1 time: 0.260740 Jul 19 15:49:46.256147 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 297/648] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:49:45 2022] GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519 => generated 1678 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:49:46.317893 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-4a144af1-86bf-4b55-8186-375585299eb9 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:46.318823 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-4a144af1-86bf-4b55-8186-375585299eb9 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: d1382aa7-6d93-410a-94ae-a7944114573f] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:46.324879 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-4a144af1-86bf-4b55-8186-375585299eb9 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:46.325332 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-4a144af1-86bf-4b55-8186-375585299eb9 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:46.326126 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-4a144af1-86bf-4b55-8186-375585299eb9 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:46.326614 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-4a144af1-86bf-4b55-8186-375585299eb9 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:46.485526 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.virt.hardware [None req-a890c6b6-8a8d-4508-bfa7-40603fa6bf0a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Flavor limits 0:0:0 {{(pid=129520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 15:49:46.485943 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.virt.hardware [None req-a890c6b6-8a8d-4508-bfa7-40603fa6bf0a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Image limits 0:0:0 {{(pid=129520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 15:49:46.486457 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.virt.hardware [None req-a890c6b6-8a8d-4508-bfa7-40603fa6bf0a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Flavor pref 0:0:0 {{(pid=129520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 15:49:46.486872 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.virt.hardware [None req-a890c6b6-8a8d-4508-bfa7-40603fa6bf0a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Image pref 0:0:0 {{(pid=129520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 15:49:46.487281 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.virt.hardware [None req-a890c6b6-8a8d-4508-bfa7-40603fa6bf0a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 15:49:46.496834 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-a890c6b6-8a8d-4508-bfa7-40603fa6bf0a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:46.497324 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-a890c6b6-8a8d-4508-bfa7-40603fa6bf0a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:46.498119 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-a890c6b6-8a8d-4508-bfa7-40603fa6bf0a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:46.498582 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-a890c6b6-8a8d-4508-bfa7-40603fa6bf0a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:46.517623 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.quota [None req-a890c6b6-8a8d-4508-bfa7-40603fa6bf0a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Getting quotas for project 171a2f5462994c8d98ffd8cbc2ce5677. Resources: {'ram', 'instances', 'cores'} {{(pid=129520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 15:49:46.522193 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.quota [None req-a890c6b6-8a8d-4508-bfa7-40603fa6bf0a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Getting quotas for user fca86639f2d344be97cb1529dc17f62a and project 171a2f5462994c8d98ffd8cbc2ce5677. Resources: {'ram', 'instances', 'cores'} {{(pid=129520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 15:49:46.536048 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-a890c6b6-8a8d-4508-bfa7-40603fa6bf0a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Going to run 1 instances... {{(pid=129520) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 15:49:46.538724 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-a890c6b6-8a8d-4508-bfa7-40603fa6bf0a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: df3309b1-ba0f-4f40-937f-fc95c9c8f6a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='15012099-fe38-45ac-bd33-d884a5ba65f2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 15:49:46.587898 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-a890c6b6-8a8d-4508-bfa7-40603fa6bf0a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.649717 Jul 19 15:49:46.588865 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 352/649] 10.222.0.64 () {62 vars in 1187 bytes} [Tue Jul 19 15:49:45 2022] POST /compute/v2.1/servers => generated 402 bytes in 652 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 19 15:49:46.593530 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-1daf3695-35f9-452f-9988-2a73b1b603f3 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:46.594484 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-1daf3695-35f9-452f-9988-2a73b1b603f3 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 0194ecf2-5e08-49b2-a4e9-185bf9b32e40] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:46.603816 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-1daf3695-35f9-452f-9988-2a73b1b603f3 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:46.604508 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-1daf3695-35f9-452f-9988-2a73b1b603f3 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:46.605449 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-1daf3695-35f9-452f-9988-2a73b1b603f3 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:46.606033 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-1daf3695-35f9-452f-9988-2a73b1b603f3 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:46.732112 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-4a144af1-86bf-4b55-8186-375585299eb9 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7c42cf0bc84292bb0b7edb9f2e7fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a72d232f314a78b0e1c3f04b0ed682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:46.741308 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-4a144af1-86bf-4b55-8186-375585299eb9 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/d1382aa7-6d93-410a-94ae-a7944114573f" status: 200 len: 1366 microversion: 2.1 time: 0.427915 Jul 19 15:49:46.741894 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 298/650] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:49:46 2022] GET /compute/v2.1/servers/d1382aa7-6d93-410a-94ae-a7944114573f => generated 1366 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:49:46.746660 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-a86d9e18-2aa6-4d4f-ab0e-35c1c84f6f5b tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:46.747338 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-a86d9e18-2aa6-4d4f-ab0e-35c1c84f6f5b tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: df3309b1-ba0f-4f40-937f-fc95c9c8f6a0] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:46.818582 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-a86d9e18-2aa6-4d4f-ab0e-35c1c84f6f5b tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:46.826104 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-a86d9e18-2aa6-4d4f-ab0e-35c1c84f6f5b tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:46.832556 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-a86d9e18-2aa6-4d4f-ab0e-35c1c84f6f5b tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:46.835343 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-a86d9e18-2aa6-4d4f-ab0e-35c1c84f6f5b tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0" status: 200 len: 1282 microversion: 2.20 time: 0.092186 Jul 19 15:49:46.836330 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 299/651] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:49:46 2022] GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0 => generated 1282 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:49:46.836498 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-1daf3695-35f9-452f-9988-2a73b1b603f3 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:46.847768 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-1daf3695-35f9-452f-9988-2a73b1b603f3 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40" status: 200 len: 1735 microversion: 2.1 time: 0.255783 Jul 19 15:49:46.847768 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 353/652] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:49:46 2022] GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40 => generated 1735 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:49:47.273169 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-589cf515-aa88-4172-a050-5204683b2b48 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:47.273721 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-589cf515-aa88-4172-a050-5204683b2b48 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 343ae383-5bfd-4c70-8926-a800fcee3519] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:47.280819 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-589cf515-aa88-4172-a050-5204683b2b48 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:47.281264 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-589cf515-aa88-4172-a050-5204683b2b48 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:47.282223 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-589cf515-aa88-4172-a050-5204683b2b48 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:47.282684 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-589cf515-aa88-4172-a050-5204683b2b48 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:47.415107 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-589cf515-aa88-4172-a050-5204683b2b48 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c75043813844d79fd0764132dfe4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e234f713b40cd8772372c2316dd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:47.423003 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-589cf515-aa88-4172-a050-5204683b2b48 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519" status: 200 len: 1678 microversion: 2.1 time: 0.153720 Jul 19 15:49:47.423569 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 300/653] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:49:47 2022] GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:49:47.758612 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-f9efd5a0-380c-4511-8d5f-43e4f3b0cdae tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:47.759227 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-f9efd5a0-380c-4511-8d5f-43e4f3b0cdae tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: d1382aa7-6d93-410a-94ae-a7944114573f] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:47.765989 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-f9efd5a0-380c-4511-8d5f-43e4f3b0cdae tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:47.766401 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-f9efd5a0-380c-4511-8d5f-43e4f3b0cdae tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:47.767169 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-f9efd5a0-380c-4511-8d5f-43e4f3b0cdae tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:47.767603 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-f9efd5a0-380c-4511-8d5f-43e4f3b0cdae tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:47.854965 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-19a2310f-8ebb-48f0-9a89-89c9a959dd40 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:47.855652 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-19a2310f-8ebb-48f0-9a89-89c9a959dd40 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: df3309b1-ba0f-4f40-937f-fc95c9c8f6a0] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:47.864114 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-19a2310f-8ebb-48f0-9a89-89c9a959dd40 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:47.864567 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-19a2310f-8ebb-48f0-9a89-89c9a959dd40 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:47.865345 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-19a2310f-8ebb-48f0-9a89-89c9a959dd40 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:47.865949 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-19a2310f-8ebb-48f0-9a89-89c9a959dd40 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:47.907025 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-f9efd5a0-380c-4511-8d5f-43e4f3b0cdae tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7c42cf0bc84292bb0b7edb9f2e7fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a72d232f314a78b0e1c3f04b0ed682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:47.915256 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-f9efd5a0-380c-4511-8d5f-43e4f3b0cdae tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/d1382aa7-6d93-410a-94ae-a7944114573f" status: 200 len: 1366 microversion: 2.1 time: 0.160439 Jul 19 15:49:47.915839 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 354/654] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:49:47 2022] GET /compute/v2.1/servers/d1382aa7-6d93-410a-94ae-a7944114573f => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:49:47.920214 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-ea6989d8-d8bc-4703-8e3d-32d4ff9dad3c tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:47.920812 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-ea6989d8-d8bc-4703-8e3d-32d4ff9dad3c tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 0194ecf2-5e08-49b2-a4e9-185bf9b32e40] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:47.927746 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-ea6989d8-d8bc-4703-8e3d-32d4ff9dad3c tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:47.928158 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-ea6989d8-d8bc-4703-8e3d-32d4ff9dad3c tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:47.928922 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-ea6989d8-d8bc-4703-8e3d-32d4ff9dad3c tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:47.929379 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-ea6989d8-d8bc-4703-8e3d-32d4ff9dad3c tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:47.930109 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-19a2310f-8ebb-48f0-9a89-89c9a959dd40 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:47.938478 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-19a2310f-8ebb-48f0-9a89-89c9a959dd40 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:47.940055 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-19a2310f-8ebb-48f0-9a89-89c9a959dd40 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:47.941183 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-19a2310f-8ebb-48f0-9a89-89c9a959dd40 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0" status: 200 len: 1286 microversion: 2.20 time: 0.090688 Jul 19 15:49:47.941744 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 301/655] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:49:47 2022] GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0 => generated 1286 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:49:48.060904 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-ea6989d8-d8bc-4703-8e3d-32d4ff9dad3c tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:48.069447 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-ea6989d8-d8bc-4703-8e3d-32d4ff9dad3c tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40" status: 200 len: 1735 microversion: 2.1 time: 0.152661 Jul 19 15:49:48.070026 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 355/656] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:49:47 2022] GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40 => generated 1735 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:49:48.440264 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-ef1db10c-ab6c-424e-8f93-7aad64bdf27e tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:48.440864 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-ef1db10c-ab6c-424e-8f93-7aad64bdf27e tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 343ae383-5bfd-4c70-8926-a800fcee3519] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:48.447629 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-ef1db10c-ab6c-424e-8f93-7aad64bdf27e tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:48.448077 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-ef1db10c-ab6c-424e-8f93-7aad64bdf27e tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:48.448895 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-ef1db10c-ab6c-424e-8f93-7aad64bdf27e tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:48.449329 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-ef1db10c-ab6c-424e-8f93-7aad64bdf27e tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:48.577877 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-ef1db10c-ab6c-424e-8f93-7aad64bdf27e tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c75043813844d79fd0764132dfe4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e234f713b40cd8772372c2316dd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:48.585785 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-ef1db10c-ab6c-424e-8f93-7aad64bdf27e tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519" status: 200 len: 1678 microversion: 2.1 time: 0.149578 Jul 19 15:49:48.586344 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 302/657] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:49:48 2022] GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519 => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:49:48.932653 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-c01c680f-ada4-49c0-8f59-fa1200d8bd4f tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:48.933261 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-c01c680f-ada4-49c0-8f59-fa1200d8bd4f tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: d1382aa7-6d93-410a-94ae-a7944114573f] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:48.939840 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-c01c680f-ada4-49c0-8f59-fa1200d8bd4f tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:48.940289 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-c01c680f-ada4-49c0-8f59-fa1200d8bd4f tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:48.941046 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-c01c680f-ada4-49c0-8f59-fa1200d8bd4f tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:48.941484 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-c01c680f-ada4-49c0-8f59-fa1200d8bd4f tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:48.959716 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-1798af05-d092-4c7c-9a30-b7531e34b50a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:48.960312 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-1798af05-d092-4c7c-9a30-b7531e34b50a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: df3309b1-ba0f-4f40-937f-fc95c9c8f6a0] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:48.966159 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-1798af05-d092-4c7c-9a30-b7531e34b50a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:48.966629 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-1798af05-d092-4c7c-9a30-b7531e34b50a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:48.967379 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-1798af05-d092-4c7c-9a30-b7531e34b50a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:48.967810 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-1798af05-d092-4c7c-9a30-b7531e34b50a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:49.033399 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-1798af05-d092-4c7c-9a30-b7531e34b50a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:49.041944 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-1798af05-d092-4c7c-9a30-b7531e34b50a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:49.043459 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-1798af05-d092-4c7c-9a30-b7531e34b50a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:49.044538 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-1798af05-d092-4c7c-9a30-b7531e34b50a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0" status: 200 len: 1286 microversion: 2.20 time: 0.088885 Jul 19 15:49:49.045080 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 303/658] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:49:48 2022] GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0 => generated 1286 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 15:49:49.074715 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-c01c680f-ada4-49c0-8f59-fa1200d8bd4f tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7c42cf0bc84292bb0b7edb9f2e7fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a72d232f314a78b0e1c3f04b0ed682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:49.083222 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-c01c680f-ada4-49c0-8f59-fa1200d8bd4f tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/d1382aa7-6d93-410a-94ae-a7944114573f" status: 200 len: 1366 microversion: 2.1 time: 0.154391 Jul 19 15:49:49.083941 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 356/659] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:49:48 2022] GET /compute/v2.1/servers/d1382aa7-6d93-410a-94ae-a7944114573f => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:49:49.087452 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-ace38ba5-fcae-4ab1-adbc-ab79bca877c4 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:49.088209 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-ace38ba5-fcae-4ab1-adbc-ab79bca877c4 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 0194ecf2-5e08-49b2-a4e9-185bf9b32e40] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:49.094799 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-ace38ba5-fcae-4ab1-adbc-ab79bca877c4 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:49.095244 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-ace38ba5-fcae-4ab1-adbc-ab79bca877c4 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:49.096003 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-ace38ba5-fcae-4ab1-adbc-ab79bca877c4 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:49.096431 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-ace38ba5-fcae-4ab1-adbc-ab79bca877c4 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:49.226342 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-ace38ba5-fcae-4ab1-adbc-ab79bca877c4 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:49.239790 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-ace38ba5-fcae-4ab1-adbc-ab79bca877c4 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40" status: 200 len: 1735 microversion: 2.1 time: 0.156142 Jul 19 15:49:49.240363 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 304/660] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:49:49 2022] GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40 => generated 1735 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:49:49.604873 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-2e3f2c73-7f31-417c-ae3c-6ed01cfa4bfa tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:49.605485 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-2e3f2c73-7f31-417c-ae3c-6ed01cfa4bfa tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 343ae383-5bfd-4c70-8926-a800fcee3519] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:49.612294 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-2e3f2c73-7f31-417c-ae3c-6ed01cfa4bfa tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:49.612829 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-2e3f2c73-7f31-417c-ae3c-6ed01cfa4bfa tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:49.613708 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-2e3f2c73-7f31-417c-ae3c-6ed01cfa4bfa tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:49.614199 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-2e3f2c73-7f31-417c-ae3c-6ed01cfa4bfa tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:49.744264 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-2e3f2c73-7f31-417c-ae3c-6ed01cfa4bfa tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c75043813844d79fd0764132dfe4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e234f713b40cd8772372c2316dd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:49.752692 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-2e3f2c73-7f31-417c-ae3c-6ed01cfa4bfa tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519" status: 200 len: 1678 microversion: 2.1 time: 0.151630 Jul 19 15:49:49.753259 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 357/661] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:49:49 2022] GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519 => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:49:50.061952 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-96d4dea3-508d-4a85-9a88-962891a882cb tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:50.062582 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-96d4dea3-508d-4a85-9a88-962891a882cb tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: df3309b1-ba0f-4f40-937f-fc95c9c8f6a0] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:50.069694 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-96d4dea3-508d-4a85-9a88-962891a882cb tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:50.070134 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-96d4dea3-508d-4a85-9a88-962891a882cb tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:50.070912 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-96d4dea3-508d-4a85-9a88-962891a882cb tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:50.071344 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-96d4dea3-508d-4a85-9a88-962891a882cb tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:50.100529 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-68a68636-aec7-460a-970e-6b3b179b4ab2 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:50.101373 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-68a68636-aec7-460a-970e-6b3b179b4ab2 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: d1382aa7-6d93-410a-94ae-a7944114573f] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:50.107952 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-68a68636-aec7-460a-970e-6b3b179b4ab2 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:50.108502 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-68a68636-aec7-460a-970e-6b3b179b4ab2 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:50.109343 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-68a68636-aec7-460a-970e-6b3b179b4ab2 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:50.110391 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-68a68636-aec7-460a-970e-6b3b179b4ab2 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:50.132437 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-96d4dea3-508d-4a85-9a88-962891a882cb tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:50.140483 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-96d4dea3-508d-4a85-9a88-962891a882cb tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:50.142049 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-96d4dea3-508d-4a85-9a88-962891a882cb tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:50.143224 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-96d4dea3-508d-4a85-9a88-962891a882cb tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0" status: 200 len: 1286 microversion: 2.20 time: 0.085161 Jul 19 15:49:50.143781 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 305/662] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:49:50 2022] GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0 => generated 1286 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 15:49:50.251022 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-68a68636-aec7-460a-970e-6b3b179b4ab2 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7c42cf0bc84292bb0b7edb9f2e7fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a72d232f314a78b0e1c3f04b0ed682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:50.253360 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG dbcounter [-] [129520] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:49:50.257221 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-33ff2f88-5064-468e-83e3-dcd64348f7d5 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:50.257826 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-33ff2f88-5064-468e-83e3-dcd64348f7d5 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 0194ecf2-5e08-49b2-a4e9-185bf9b32e40] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:50.259776 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-68a68636-aec7-460a-970e-6b3b179b4ab2 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/d1382aa7-6d93-410a-94ae-a7944114573f" status: 200 len: 1366 microversion: 2.1 time: 0.163082 Jul 19 15:49:50.260357 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 358/663] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:49:50 2022] GET /compute/v2.1/servers/d1382aa7-6d93-410a-94ae-a7944114573f => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:49:50.264107 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-33ff2f88-5064-468e-83e3-dcd64348f7d5 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:50.264583 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-33ff2f88-5064-468e-83e3-dcd64348f7d5 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:50.265339 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-33ff2f88-5064-468e-83e3-dcd64348f7d5 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:50.265776 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-33ff2f88-5064-468e-83e3-dcd64348f7d5 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:50.465296 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-33ff2f88-5064-468e-83e3-dcd64348f7d5 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:50.474121 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-33ff2f88-5064-468e-83e3-dcd64348f7d5 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40" status: 200 len: 1735 microversion: 2.1 time: 0.221114 Jul 19 15:49:50.474910 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 306/664] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:49:50 2022] GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40 => generated 1735 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:49:50.769518 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-ea43be84-36e6-489c-84a1-98805ee9a65a tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:50.770067 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-ea43be84-36e6-489c-84a1-98805ee9a65a tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 343ae383-5bfd-4c70-8926-a800fcee3519] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:50.777165 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-ea43be84-36e6-489c-84a1-98805ee9a65a tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:50.777613 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-ea43be84-36e6-489c-84a1-98805ee9a65a tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:50.778405 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-ea43be84-36e6-489c-84a1-98805ee9a65a tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:50.778846 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-ea43be84-36e6-489c-84a1-98805ee9a65a tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:50.909828 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-ea43be84-36e6-489c-84a1-98805ee9a65a tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c75043813844d79fd0764132dfe4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e234f713b40cd8772372c2316dd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:50.917555 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-ea43be84-36e6-489c-84a1-98805ee9a65a tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519" status: 200 len: 1678 microversion: 2.1 time: 0.152464 Jul 19 15:49:50.918117 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 359/665] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:49:50 2022] GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:49:51.161547 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-416ed9f7-fa70-417c-9b92-bd42ae237ee3 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:51.162177 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-416ed9f7-fa70-417c-9b92-bd42ae237ee3 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: df3309b1-ba0f-4f40-937f-fc95c9c8f6a0] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:51.169127 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-416ed9f7-fa70-417c-9b92-bd42ae237ee3 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:51.169567 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-416ed9f7-fa70-417c-9b92-bd42ae237ee3 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:51.170658 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-416ed9f7-fa70-417c-9b92-bd42ae237ee3 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:51.170846 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-416ed9f7-fa70-417c-9b92-bd42ae237ee3 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:51.239628 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-416ed9f7-fa70-417c-9b92-bd42ae237ee3 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:51.248565 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-416ed9f7-fa70-417c-9b92-bd42ae237ee3 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:51.249754 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-416ed9f7-fa70-417c-9b92-bd42ae237ee3 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:51.251256 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-416ed9f7-fa70-417c-9b92-bd42ae237ee3 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0" status: 200 len: 1278 microversion: 2.20 time: 0.093550 Jul 19 15:49:51.254962 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 307/666] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:49:51 2022] GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0 => generated 1278 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:49:51.279503 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-38499198-10a6-4f33-aef2-2193c05e7412 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:51.280111 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-38499198-10a6-4f33-aef2-2193c05e7412 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: d1382aa7-6d93-410a-94ae-a7944114573f] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:51.288119 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-38499198-10a6-4f33-aef2-2193c05e7412 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:51.288934 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-38499198-10a6-4f33-aef2-2193c05e7412 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:51.289749 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-38499198-10a6-4f33-aef2-2193c05e7412 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:51.290241 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-38499198-10a6-4f33-aef2-2193c05e7412 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:51.450021 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-38499198-10a6-4f33-aef2-2193c05e7412 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7c42cf0bc84292bb0b7edb9f2e7fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a72d232f314a78b0e1c3f04b0ed682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:51.458535 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-38499198-10a6-4f33-aef2-2193c05e7412 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/d1382aa7-6d93-410a-94ae-a7944114573f" status: 200 len: 1366 microversion: 2.1 time: 0.182744 Jul 19 15:49:51.459196 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 360/667] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:49:51 2022] GET /compute/v2.1/servers/d1382aa7-6d93-410a-94ae-a7944114573f => generated 1366 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:49:51.491573 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-9b2051fc-afdb-4768-a32f-2bb278ec189a tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:51.492189 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-9b2051fc-afdb-4768-a32f-2bb278ec189a tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 0194ecf2-5e08-49b2-a4e9-185bf9b32e40] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:51.498715 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-9b2051fc-afdb-4768-a32f-2bb278ec189a tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:51.499166 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-9b2051fc-afdb-4768-a32f-2bb278ec189a tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:51.499934 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-9b2051fc-afdb-4768-a32f-2bb278ec189a tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:51.500993 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-9b2051fc-afdb-4768-a32f-2bb278ec189a tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:51.634082 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-9b2051fc-afdb-4768-a32f-2bb278ec189a tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:51.642763 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-9b2051fc-afdb-4768-a32f-2bb278ec189a tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40" status: 200 len: 1735 microversion: 2.1 time: 0.154826 Jul 19 15:49:51.643329 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 308/668] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:49:51 2022] GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40 => generated 1735 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:49:51.934284 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-5fbc74d1-64d0-4c25-a8aa-5aa52cf6c6ba tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:51.934913 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-5fbc74d1-64d0-4c25-a8aa-5aa52cf6c6ba tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 343ae383-5bfd-4c70-8926-a800fcee3519] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:51.941743 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-5fbc74d1-64d0-4c25-a8aa-5aa52cf6c6ba tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:51.943055 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-5fbc74d1-64d0-4c25-a8aa-5aa52cf6c6ba tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:51.944144 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-5fbc74d1-64d0-4c25-a8aa-5aa52cf6c6ba tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:51.944595 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-5fbc74d1-64d0-4c25-a8aa-5aa52cf6c6ba tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:52.076929 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-5fbc74d1-64d0-4c25-a8aa-5aa52cf6c6ba tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c75043813844d79fd0764132dfe4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e234f713b40cd8772372c2316dd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:52.084484 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-5fbc74d1-64d0-4c25-a8aa-5aa52cf6c6ba tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519" status: 200 len: 1678 microversion: 2.1 time: 0.154106 Jul 19 15:49:52.085057 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 361/669] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:49:51 2022] GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519 => generated 1678 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:49:52.269908 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-00fe79b0-0997-4197-9f8e-e9eb56cab7e0 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:52.270547 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-00fe79b0-0997-4197-9f8e-e9eb56cab7e0 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: df3309b1-ba0f-4f40-937f-fc95c9c8f6a0] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:52.277413 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-00fe79b0-0997-4197-9f8e-e9eb56cab7e0 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:52.277921 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-00fe79b0-0997-4197-9f8e-e9eb56cab7e0 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:52.278729 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-00fe79b0-0997-4197-9f8e-e9eb56cab7e0 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:52.279163 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-00fe79b0-0997-4197-9f8e-e9eb56cab7e0 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:52.355410 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-00fe79b0-0997-4197-9f8e-e9eb56cab7e0 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:52.368227 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-00fe79b0-0997-4197-9f8e-e9eb56cab7e0 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:52.370044 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-00fe79b0-0997-4197-9f8e-e9eb56cab7e0 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:52.371454 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-00fe79b0-0997-4197-9f8e-e9eb56cab7e0 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0" status: 200 len: 1340 microversion: 2.20 time: 0.106366 Jul 19 15:49:52.372545 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 309/670] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:49:52 2022] GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0 => generated 1340 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:49:52.477686 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-d215ae84-52c4-4134-bf37-ffbbfeba4f47 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:52.478411 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-d215ae84-52c4-4134-bf37-ffbbfeba4f47 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: d1382aa7-6d93-410a-94ae-a7944114573f] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:52.490426 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-d215ae84-52c4-4134-bf37-ffbbfeba4f47 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:52.491560 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-d215ae84-52c4-4134-bf37-ffbbfeba4f47 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:52.492577 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-d215ae84-52c4-4134-bf37-ffbbfeba4f47 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:52.493538 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-d215ae84-52c4-4134-bf37-ffbbfeba4f47 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:52.661835 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-57b40af6-f013-49c1-b47e-42a92832bf05 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:52.662948 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-57b40af6-f013-49c1-b47e-42a92832bf05 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 0194ecf2-5e08-49b2-a4e9-185bf9b32e40] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:52.670125 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-57b40af6-f013-49c1-b47e-42a92832bf05 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:52.670721 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-57b40af6-f013-49c1-b47e-42a92832bf05 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:52.671495 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-57b40af6-f013-49c1-b47e-42a92832bf05 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:52.672274 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-57b40af6-f013-49c1-b47e-42a92832bf05 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:52.714160 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-d215ae84-52c4-4134-bf37-ffbbfeba4f47 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7c42cf0bc84292bb0b7edb9f2e7fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a72d232f314a78b0e1c3f04b0ed682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:52.726965 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-d215ae84-52c4-4134-bf37-ffbbfeba4f47 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/d1382aa7-6d93-410a-94ae-a7944114573f" status: 200 len: 1366 microversion: 2.1 time: 0.254723 Jul 19 15:49:52.727573 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 362/671] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:49:52 2022] GET /compute/v2.1/servers/d1382aa7-6d93-410a-94ae-a7944114573f => generated 1366 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:49:52.825803 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-57b40af6-f013-49c1-b47e-42a92832bf05 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:52.835529 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-57b40af6-f013-49c1-b47e-42a92832bf05 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40" status: 200 len: 1735 microversion: 2.1 time: 0.178485 Jul 19 15:49:52.836117 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 310/672] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:49:52 2022] GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40 => generated 1735 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:49:53.101436 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-d1bc8675-aa2c-485a-81a2-496aef3b2dd5 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:53.102087 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-d1bc8675-aa2c-485a-81a2-496aef3b2dd5 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 343ae383-5bfd-4c70-8926-a800fcee3519] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:53.108518 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-d1bc8675-aa2c-485a-81a2-496aef3b2dd5 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:53.108963 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-d1bc8675-aa2c-485a-81a2-496aef3b2dd5 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:53.110530 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-d1bc8675-aa2c-485a-81a2-496aef3b2dd5 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:53.111007 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-d1bc8675-aa2c-485a-81a2-496aef3b2dd5 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:53.240525 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-d1bc8675-aa2c-485a-81a2-496aef3b2dd5 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c75043813844d79fd0764132dfe4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e234f713b40cd8772372c2316dd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:53.248207 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-d1bc8675-aa2c-485a-81a2-496aef3b2dd5 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519" status: 200 len: 1678 microversion: 2.1 time: 0.150934 Jul 19 15:49:53.248767 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 363/673] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:49:53 2022] GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519 => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:49:53.390309 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-ab2dbea0-8bc5-465c-90bc-f1a8409602dd tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:53.391208 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-ab2dbea0-8bc5-465c-90bc-f1a8409602dd tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: df3309b1-ba0f-4f40-937f-fc95c9c8f6a0] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:53.398095 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-ab2dbea0-8bc5-465c-90bc-f1a8409602dd tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:53.398508 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-ab2dbea0-8bc5-465c-90bc-f1a8409602dd tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:53.399274 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-ab2dbea0-8bc5-465c-90bc-f1a8409602dd tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:53.399715 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-ab2dbea0-8bc5-465c-90bc-f1a8409602dd tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:53.538989 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-ab2dbea0-8bc5-465c-90bc-f1a8409602dd tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:53.547399 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-ab2dbea0-8bc5-465c-90bc-f1a8409602dd tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:53.548920 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-ab2dbea0-8bc5-465c-90bc-f1a8409602dd tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:53.550025 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-ab2dbea0-8bc5-465c-90bc-f1a8409602dd tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0" status: 200 len: 1408 microversion: 2.20 time: 0.163686 Jul 19 15:49:53.550615 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 311/674] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:49:53 2022] GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0 => generated 1408 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:49:53.747671 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-0a4eb54f-a74b-465f-9163-1221fff06582 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:53.748281 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-0a4eb54f-a74b-465f-9163-1221fff06582 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: d1382aa7-6d93-410a-94ae-a7944114573f] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:53.756252 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-0a4eb54f-a74b-465f-9163-1221fff06582 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:53.756644 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-0a4eb54f-a74b-465f-9163-1221fff06582 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:53.757419 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-0a4eb54f-a74b-465f-9163-1221fff06582 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:53.757855 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-0a4eb54f-a74b-465f-9163-1221fff06582 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:53.857777 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-0b1e467d-46bf-4dfe-a9ea-6cbfb01d48ae tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:53.858877 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-0b1e467d-46bf-4dfe-a9ea-6cbfb01d48ae tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 0194ecf2-5e08-49b2-a4e9-185bf9b32e40] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:53.867767 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-0b1e467d-46bf-4dfe-a9ea-6cbfb01d48ae tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:53.868495 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-0b1e467d-46bf-4dfe-a9ea-6cbfb01d48ae tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:53.870256 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-0b1e467d-46bf-4dfe-a9ea-6cbfb01d48ae tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:53.871885 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-0b1e467d-46bf-4dfe-a9ea-6cbfb01d48ae tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:53.984344 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-0a4eb54f-a74b-465f-9163-1221fff06582 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7c42cf0bc84292bb0b7edb9f2e7fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a72d232f314a78b0e1c3f04b0ed682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:53.993127 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-0a4eb54f-a74b-465f-9163-1221fff06582 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/d1382aa7-6d93-410a-94ae-a7944114573f" status: 200 len: 1366 microversion: 2.1 time: 0.249961 Jul 19 15:49:54.003083 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 364/675] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:49:53 2022] GET /compute/v2.1/servers/d1382aa7-6d93-410a-94ae-a7944114573f => generated 1366 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:49:54.030036 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-0b1e467d-46bf-4dfe-a9ea-6cbfb01d48ae tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:54.038300 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-0b1e467d-46bf-4dfe-a9ea-6cbfb01d48ae tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40" status: 200 len: 1715 microversion: 2.1 time: 0.188443 Jul 19 15:49:54.039169 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 312/676] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:49:53 2022] GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40 => generated 1715 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:49:54.078437 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [req-03820dd5-3e13-470d-8329-0bfd43865e6b req-58884f0e-a94c-4a32-a0a3-b88929237dc8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df3309b1-ba0f-4f40-937f-fc95c9c8f6a0", "tag": "f79bc5b8-5b78-4990-ae5f-977bb42032bd"}]} {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:49:54.089694 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [req-03820dd5-3e13-470d-8329-0bfd43865e6b req-58884f0e-a94c-4a32-a0a3-b88929237dc8 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:54.090214 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [req-03820dd5-3e13-470d-8329-0bfd43865e6b req-58884f0e-a94c-4a32-a0a3-b88929237dc8 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:54.104135 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.compute.server_external_events [req-03820dd5-3e13-470d-8329-0bfd43865e6b req-58884f0e-a94c-4a32-a0a3-b88929237dc8 service nova] Creating event network-changed:f79bc5b8-5b78-4990-ae5f-977bb42032bd for instance df3309b1-ba0f-4f40-937f-fc95c9c8f6a0 on hv-cinder-84902 Jul 19 15:49:54.112041 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [req-03820dd5-3e13-470d-8329-0bfd43865e6b req-58884f0e-a94c-4a32-a0a3-b88929237dc8 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038122 Jul 19 15:49:54.112657 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 365/677] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Jul 19 15:49:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:49:54.174728 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-4821a38c-9a6e-425d-8e2e-1c3487292ac2 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:54.175329 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-4821a38c-9a6e-425d-8e2e-1c3487292ac2 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 0194ecf2-5e08-49b2-a4e9-185bf9b32e40] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:54.184010 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-4821a38c-9a6e-425d-8e2e-1c3487292ac2 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:54.184666 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-4821a38c-9a6e-425d-8e2e-1c3487292ac2 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:54.185463 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-4821a38c-9a6e-425d-8e2e-1c3487292ac2 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:54.185964 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-4821a38c-9a6e-425d-8e2e-1c3487292ac2 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:54.265685 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-a99ba7a9-a115-49fc-80a7-477f8ab31e41 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:54.266676 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-a99ba7a9-a115-49fc-80a7-477f8ab31e41 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 343ae383-5bfd-4c70-8926-a800fcee3519] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:54.275714 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-a99ba7a9-a115-49fc-80a7-477f8ab31e41 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:54.277533 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-a99ba7a9-a115-49fc-80a7-477f8ab31e41 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:54.279996 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-a99ba7a9-a115-49fc-80a7-477f8ab31e41 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:54.280547 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-a99ba7a9-a115-49fc-80a7-477f8ab31e41 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:54.302564 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.wsgi [None req-4821a38c-9a6e-425d-8e2e-1c3487292ac2 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] HTTP exception thrown: Cannot 'detach_volume' instance 0194ecf2-5e08-49b2-a4e9-185bf9b32e40 while it is in vm_state rescued Jul 19 15:49:54.304197 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-4821a38c-9a6e-425d-8e2e-1c3487292ac2 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Request method failure captured: Jul 19 15:49:54.304197 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: request: DELETE /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40/os-volume_attachments/b0fb4360-eb9d-4a23-87ae-d1f240088e56 HTTP/1.1 Jul 19 15:49:54.304197 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Accept: application/json Jul 19 15:49:54.304197 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Accept-Encoding: identity Jul 19 15:49:54.304197 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Connection: close Jul 19 15:49:54.304197 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Content-Length: 0 Jul 19 15:49:54.304197 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Content-Type: application/json Jul 19 15:49:54.304197 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Host: 10.222.0.64 Jul 19 15:49:54.304197 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Openstack-System-Scope: None Jul 19 15:49:54.304197 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: User-Agent: python-urllib3/1.26.9 Jul 19 15:49:54.304197 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Auth-Token: gAAAAABi1tGPG3TL2GwfAc0kf5LaV9cX4pbJFxTWqQKwJFE5MwZWkdPruymWghvL56VHYnPjmTX00Dxb6n-I5a-K8qDlTUL3Rdjijr9hGViaVz0EvfiTyEi0NIlocc44JNIONZOhLldSNTzzdFWiWGRLTkuRKHFmrDA7ImfJvTM2riB9cOts4j4 Jul 19 15:49:54.304197 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Domain-Id: None Jul 19 15:49:54.304197 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Domain-Name: None Jul 19 15:49:54.304197 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Identity-Status: Confirmed Jul 19 15:49:54.304197 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Is-Admin-Project: True Jul 19 15:49:54.304197 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Domain-Id: default Jul 19 15:49:54.304197 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Domain-Name: Default Jul 19 15:49:54.304197 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Id: a872b4eafae74b82896bd09229152104 Jul 19 15:49:54.304197 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1658676 Jul 19 15:49:54.304197 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Role: member,reader Jul 19 15:49:54.304197 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Roles: member,reader Jul 19 15:49:54.305505 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_a872b4eafae74b82896bd09229152104", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a872b4eafae74b82896bd09229152104"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a872b4eafae74b82896bd09229152104"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/a872b4eafae74b82896bd09229152104"}]}] Jul 19 15:49:54.305505 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1658676 Jul 19 15:49:54.305505 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Tenant-Id: a872b4eafae74b82896bd09229152104 Jul 19 15:49:54.305505 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1658676 Jul 19 15:49:54.305505 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User: tempest-ServerRescueNegativeTestJSON-1658676-project Jul 19 15:49:54.305505 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Domain-Id: default Jul 19 15:49:54.305505 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Domain-Name: Default Jul 19 15:49:54.305505 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Id: 4785719411fd4af892868d99fca7cd71 Jul 19 15:49:54.305505 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1658676-project Jul 19 15:49:54.305505 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: method: > Jul 19 15:49:54.305505 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: exception: Cannot 'detach_volume' instance 0194ecf2-5e08-49b2-a4e9-185bf9b32e40 while it is in vm_state rescued Jul 19 15:49:54.306219 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: action_args: {'server_id': '0194ecf2-5e08-49b2-a4e9-185bf9b32e40', 'id': 'b0fb4360-eb9d-4a23-87ae-d1f240088e56'} Jul 19 15:49:54.306219 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:49:54.306219 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:49:54.306219 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 19 15:49:54.306219 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 19 15:49:54.306219 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 19 15:49:54.306219 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 15:49:54.306219 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 19 15:49:54.306219 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 19 15:49:54.306219 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 0194ecf2-5e08-49b2-a4e9-185bf9b32e40 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 19 15:49:54.306219 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:49:54.306219 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:49:54.306219 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:49:54.306219 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:49:54.306219 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:49:54.306219 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:49:54.306219 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:49:54.306219 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:49:54.306219 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:49:54.306219 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:49:54.307525 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 19 15:49:54.307525 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 19 15:49:54.307525 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 19 15:49:54.307525 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 19 15:49:54.307525 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 0194ecf2-5e08-49b2-a4e9-185bf9b32e40 while it is in vm_state rescued Jul 19 15:49:54.307525 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:49:54.307525 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:49:54.307525 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:49:54.307525 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:49:54.307525 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:49:54.307525 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:49:54.307525 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:49:54.307525 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:49:54.307525 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 0194ecf2-5e08-49b2-a4e9-185bf9b32e40 while it is in vm_state rescued Jul 19 15:49:54.307525 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:49:54.307525 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-4821a38c-9a6e-425d-8e2e-1c3487292ac2 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Returning 409 to user: Cannot 'detach_volume' instance 0194ecf2-5e08-49b2-a4e9-185bf9b32e40 while it is in vm_state rescued {{(pid=129519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:49:54.308592 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-4821a38c-9a6e-425d-8e2e-1c3487292ac2 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "DELETE /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40/os-volume_attachments/b0fb4360-eb9d-4a23-87ae-d1f240088e56" status: 409 len: 152 microversion: 2.1 time: 0.136011 Jul 19 15:49:54.308592 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 313/678] 10.222.0.64 () {58 vars in 1415 bytes} [Tue Jul 19 15:49:54 2022] DELETE /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40/os-volume_attachments/b0fb4360-eb9d-4a23-87ae-d1f240088e56 => generated 152 bytes in 137 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 19 15:49:54.315296 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-da7d8ec8-8965-4666-a046-087812f51500 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:49:54.315837 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-da7d8ec8-8965-4666-a046-087812f51500 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 0194ecf2-5e08-49b2-a4e9-185bf9b32e40] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:54.323063 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-da7d8ec8-8965-4666-a046-087812f51500 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:54.323517 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-da7d8ec8-8965-4666-a046-087812f51500 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:54.324550 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-da7d8ec8-8965-4666-a046-087812f51500 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:54.324991 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-da7d8ec8-8965-4666-a046-087812f51500 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:54.374735 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG dbcounter [-] [129519] Writing DB stats nova_cell1:SELECT=100 {{(pid=129519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:49:54.408502 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-da7d8ec8-8965-4666-a046-087812f51500 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "POST /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40/action" status: 202 len: 0 microversion: 2.1 time: 0.097143 Jul 19 15:49:54.409172 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 314/679] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Jul 19 15:49:54 2022] POST /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 15:49:54.418117 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [req-a614faeb-9be8-4a0d-9f33-e6bb7b37ae17 req-6dc90045-cb24-4969-9181-aa816dcd65e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1382aa7-6d93-410a-94ae-a7944114573f", "name": "network-vif-plugged", "status": "completed", "tag": "baf9abd3-9c5d-45c3-81b3-843072591796"}]} {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:49:54.426929 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [req-a614faeb-9be8-4a0d-9f33-e6bb7b37ae17 req-6dc90045-cb24-4969-9181-aa816dcd65e4 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:54.427385 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [req-a614faeb-9be8-4a0d-9f33-e6bb7b37ae17 req-6dc90045-cb24-4969-9181-aa816dcd65e4 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:54.441036 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.compute.server_external_events [req-a614faeb-9be8-4a0d-9f33-e6bb7b37ae17 req-6dc90045-cb24-4969-9181-aa816dcd65e4 service nova] Creating event network-vif-plugged:baf9abd3-9c5d-45c3-81b3-843072591796 for instance d1382aa7-6d93-410a-94ae-a7944114573f on hv-cinder-84902 Jul 19 15:49:54.447271 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [req-a614faeb-9be8-4a0d-9f33-e6bb7b37ae17 req-6dc90045-cb24-4969-9181-aa816dcd65e4 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032819 Jul 19 15:49:54.447845 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 315/680] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Jul 19 15:49:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:49:54.453803 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-70174069-9498-4ee0-8c7c-0fcf286c45bc tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:54.454789 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-70174069-9498-4ee0-8c7c-0fcf286c45bc tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 0194ecf2-5e08-49b2-a4e9-185bf9b32e40] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:54.462211 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-70174069-9498-4ee0-8c7c-0fcf286c45bc tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:54.462828 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-70174069-9498-4ee0-8c7c-0fcf286c45bc tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:54.463602 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-70174069-9498-4ee0-8c7c-0fcf286c45bc tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:54.464260 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-70174069-9498-4ee0-8c7c-0fcf286c45bc tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:54.528236 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-a99ba7a9-a115-49fc-80a7-477f8ab31e41 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c75043813844d79fd0764132dfe4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e234f713b40cd8772372c2316dd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:54.536499 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-a99ba7a9-a115-49fc-80a7-477f8ab31e41 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519" status: 200 len: 1678 microversion: 2.1 time: 0.275188 Jul 19 15:49:54.537086 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 366/681] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:49:54 2022] GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519 => generated 1678 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:49:54.570156 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-71de666e-0085-468e-9b55-334cc3dc7fbe tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:54.570797 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-71de666e-0085-468e-9b55-334cc3dc7fbe tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: df3309b1-ba0f-4f40-937f-fc95c9c8f6a0] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:54.578902 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-71de666e-0085-468e-9b55-334cc3dc7fbe tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:54.585238 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-71de666e-0085-468e-9b55-334cc3dc7fbe tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:54.586226 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-71de666e-0085-468e-9b55-334cc3dc7fbe tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:54.586697 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-71de666e-0085-468e-9b55-334cc3dc7fbe tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:54.737808 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-70174069-9498-4ee0-8c7c-0fcf286c45bc tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:54.750625 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-70174069-9498-4ee0-8c7c-0fcf286c45bc tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40" status: 200 len: 1723 microversion: 2.1 time: 0.300373 Jul 19 15:49:54.753243 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 316/682] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:49:54 2022] GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40 => generated 1723 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:49:54.782253 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-71de666e-0085-468e-9b55-334cc3dc7fbe tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:54.791504 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-71de666e-0085-468e-9b55-334cc3dc7fbe tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:54.793071 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-71de666e-0085-468e-9b55-334cc3dc7fbe tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:54.794211 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-71de666e-0085-468e-9b55-334cc3dc7fbe tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0" status: 200 len: 1408 microversion: 2.20 time: 0.230595 Jul 19 15:49:54.794789 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 367/683] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:49:54 2022] GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0 => generated 1408 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:49:55.011013 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-3bfde32c-e0be-4d8d-9a2a-66885ae0cfa4 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:55.011644 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-3bfde32c-e0be-4d8d-9a2a-66885ae0cfa4 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: d1382aa7-6d93-410a-94ae-a7944114573f] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:55.013801 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG dbcounter [-] [129519] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=129519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:49:55.020350 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-3bfde32c-e0be-4d8d-9a2a-66885ae0cfa4 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:55.020916 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-3bfde32c-e0be-4d8d-9a2a-66885ae0cfa4 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:55.021601 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-3bfde32c-e0be-4d8d-9a2a-66885ae0cfa4 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:55.022037 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-3bfde32c-e0be-4d8d-9a2a-66885ae0cfa4 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:55.154207 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-3bfde32c-e0be-4d8d-9a2a-66885ae0cfa4 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7c42cf0bc84292bb0b7edb9f2e7fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a72d232f314a78b0e1c3f04b0ed682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:55.161786 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-3bfde32c-e0be-4d8d-9a2a-66885ae0cfa4 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/d1382aa7-6d93-410a-94ae-a7944114573f" status: 200 len: 1366 microversion: 2.1 time: 0.154877 Jul 19 15:49:55.162344 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 317/684] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:49:55 2022] GET /compute/v2.1/servers/d1382aa7-6d93-410a-94ae-a7944114573f => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:49:55.554319 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-3fa3022c-c15b-42ff-b6eb-1bc8a37d8dbe tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:55.554957 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-3fa3022c-c15b-42ff-b6eb-1bc8a37d8dbe tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 343ae383-5bfd-4c70-8926-a800fcee3519] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:55.560971 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-3fa3022c-c15b-42ff-b6eb-1bc8a37d8dbe tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:55.561416 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-3fa3022c-c15b-42ff-b6eb-1bc8a37d8dbe tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:55.562176 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-3fa3022c-c15b-42ff-b6eb-1bc8a37d8dbe tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:55.562675 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-3fa3022c-c15b-42ff-b6eb-1bc8a37d8dbe tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:55.691427 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-3fa3022c-c15b-42ff-b6eb-1bc8a37d8dbe tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c75043813844d79fd0764132dfe4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e234f713b40cd8772372c2316dd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:55.698985 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-3fa3022c-c15b-42ff-b6eb-1bc8a37d8dbe tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519" status: 200 len: 1678 microversion: 2.1 time: 0.148562 Jul 19 15:49:55.699544 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 368/685] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:49:55 2022] GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519 => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:49:55.768691 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-bed873f8-2fb9-41a9-a0cb-591127ee628d tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:55.769312 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-bed873f8-2fb9-41a9-a0cb-591127ee628d tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 0194ecf2-5e08-49b2-a4e9-185bf9b32e40] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:55.776012 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-bed873f8-2fb9-41a9-a0cb-591127ee628d tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:55.776454 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-bed873f8-2fb9-41a9-a0cb-591127ee628d tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:55.777211 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-bed873f8-2fb9-41a9-a0cb-591127ee628d tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:55.777638 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-bed873f8-2fb9-41a9-a0cb-591127ee628d tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:55.812318 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-cec06e84-4a90-43f1-bdde-45b28db30db9 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:55.813615 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-cec06e84-4a90-43f1-bdde-45b28db30db9 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: df3309b1-ba0f-4f40-937f-fc95c9c8f6a0] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:55.820240 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-cec06e84-4a90-43f1-bdde-45b28db30db9 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:55.820681 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-cec06e84-4a90-43f1-bdde-45b28db30db9 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:55.821428 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-cec06e84-4a90-43f1-bdde-45b28db30db9 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:55.821851 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-cec06e84-4a90-43f1-bdde-45b28db30db9 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:55.973748 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-cec06e84-4a90-43f1-bdde-45b28db30db9 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:55.986208 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-cec06e84-4a90-43f1-bdde-45b28db30db9 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:55.986208 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-cec06e84-4a90-43f1-bdde-45b28db30db9 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:55.986208 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-cec06e84-4a90-43f1-bdde-45b28db30db9 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0" status: 200 len: 1408 microversion: 2.20 time: 0.177629 Jul 19 15:49:55.986637 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 369/686] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:49:55 2022] GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0 => generated 1408 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 15:49:56.083501 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-bed873f8-2fb9-41a9-a0cb-591127ee628d tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:56.092776 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-bed873f8-2fb9-41a9-a0cb-591127ee628d tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40" status: 200 len: 1723 microversion: 2.1 time: 0.327958 Jul 19 15:49:56.093447 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 318/687] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:49:55 2022] GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40 => generated 1723 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:49:56.178974 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-7f81ca2d-9eeb-43ba-966d-893d6ae66107 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:56.179607 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-7f81ca2d-9eeb-43ba-966d-893d6ae66107 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: d1382aa7-6d93-410a-94ae-a7944114573f] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:56.185536 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-7f81ca2d-9eeb-43ba-966d-893d6ae66107 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:56.185986 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-7f81ca2d-9eeb-43ba-966d-893d6ae66107 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:56.186790 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-7f81ca2d-9eeb-43ba-966d-893d6ae66107 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:56.187248 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-7f81ca2d-9eeb-43ba-966d-893d6ae66107 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:56.319715 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-7f81ca2d-9eeb-43ba-966d-893d6ae66107 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7c42cf0bc84292bb0b7edb9f2e7fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a72d232f314a78b0e1c3f04b0ed682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:56.326922 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-7f81ca2d-9eeb-43ba-966d-893d6ae66107 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/d1382aa7-6d93-410a-94ae-a7944114573f" status: 200 len: 1366 microversion: 2.1 time: 0.151963 Jul 19 15:49:56.327491 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 370/688] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:49:56 2022] GET /compute/v2.1/servers/d1382aa7-6d93-410a-94ae-a7944114573f => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:49:56.716618 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-d29dca87-4c3c-4b63-bf6f-67b6bb62b311 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:56.717216 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-d29dca87-4c3c-4b63-bf6f-67b6bb62b311 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 343ae383-5bfd-4c70-8926-a800fcee3519] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:56.725287 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-d29dca87-4c3c-4b63-bf6f-67b6bb62b311 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:56.725736 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-d29dca87-4c3c-4b63-bf6f-67b6bb62b311 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:56.726558 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-d29dca87-4c3c-4b63-bf6f-67b6bb62b311 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:56.727430 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-d29dca87-4c3c-4b63-bf6f-67b6bb62b311 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:56.822934 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG dbcounter [-] [129519] Writing DB stats nova_cell0:SELECT=6 {{(pid=129519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:49:56.884169 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-d29dca87-4c3c-4b63-bf6f-67b6bb62b311 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c75043813844d79fd0764132dfe4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e234f713b40cd8772372c2316dd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:56.892482 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-d29dca87-4c3c-4b63-bf6f-67b6bb62b311 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519" status: 200 len: 1655 microversion: 2.1 time: 0.179684 Jul 19 15:49:56.893045 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 319/689] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:49:56 2022] GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519 => generated 1655 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:49:56.911717 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-8c7efd88-cbf0-4fd3-b83a-a0f887da7e2d tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:49:56.913996 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG dbcounter [-] [129520] Writing DB stats nova_cell0:SELECT=4 {{(pid=129520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:49:56.914677 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG dbcounter [-] [129520] Writing DB stats nova_cell0:SELECT=18 {{(pid=129520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:49:56.921208 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-8c7efd88-cbf0-4fd3-b83a-a0f887da7e2d tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:56.921688 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-8c7efd88-cbf0-4fd3-b83a-a0f887da7e2d tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:56.944141 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-8c7efd88-cbf0-4fd3-b83a-a0f887da7e2d tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 343ae383-5bfd-4c70-8926-a800fcee3519] Going to try to start instance {{(pid=129520) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 19 15:49:56.984706 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-8c7efd88-cbf0-4fd3-b83a-a0f887da7e2d tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "POST /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519/action" status: 202 len: 0 microversion: 2.1 time: 0.076601 Jul 19 15:49:56.985317 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 371/690] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Jul 19 15:49:56 2022] POST /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519/action => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 15:49:56.993269 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-36fa1149-5756-4578-9b69-f9714fae242a tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:56.993879 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-36fa1149-5756-4578-9b69-f9714fae242a tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 343ae383-5bfd-4c70-8926-a800fcee3519] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:57.001264 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-36fa1149-5756-4578-9b69-f9714fae242a tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:57.001719 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-36fa1149-5756-4578-9b69-f9714fae242a tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:57.002576 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-36fa1149-5756-4578-9b69-f9714fae242a tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:57.003011 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-36fa1149-5756-4578-9b69-f9714fae242a tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:57.006096 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-a89431b3-a25b-407a-9e92-aa503d51f45a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:57.007120 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-a89431b3-a25b-407a-9e92-aa503d51f45a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: df3309b1-ba0f-4f40-937f-fc95c9c8f6a0] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:57.018247 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-a89431b3-a25b-407a-9e92-aa503d51f45a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:57.018247 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-a89431b3-a25b-407a-9e92-aa503d51f45a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:57.018247 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-a89431b3-a25b-407a-9e92-aa503d51f45a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:57.018247 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-a89431b3-a25b-407a-9e92-aa503d51f45a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:57.192450 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-a89431b3-a25b-407a-9e92-aa503d51f45a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:57.201259 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-a89431b3-a25b-407a-9e92-aa503d51f45a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:57.202834 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-a89431b3-a25b-407a-9e92-aa503d51f45a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:57.205638 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-a89431b3-a25b-407a-9e92-aa503d51f45a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0" status: 200 len: 1408 microversion: 2.20 time: 0.206167 Jul 19 15:49:57.206254 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 372/691] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:49:56 2022] GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0 => generated 1408 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 15:49:57.213125 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-103f513e-259b-47d0-86b5-ef872f4a7ff6 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:57.214064 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-103f513e-259b-47d0-86b5-ef872f4a7ff6 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 0194ecf2-5e08-49b2-a4e9-185bf9b32e40] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:57.221143 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-103f513e-259b-47d0-86b5-ef872f4a7ff6 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:57.221733 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-103f513e-259b-47d0-86b5-ef872f4a7ff6 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:57.222660 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-103f513e-259b-47d0-86b5-ef872f4a7ff6 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:57.223193 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-103f513e-259b-47d0-86b5-ef872f4a7ff6 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:57.247570 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-36fa1149-5756-4578-9b69-f9714fae242a tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c75043813844d79fd0764132dfe4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e234f713b40cd8772372c2316dd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:57.259141 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-36fa1149-5756-4578-9b69-f9714fae242a tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519" status: 200 len: 1664 microversion: 2.1 time: 0.269537 Jul 19 15:49:57.260265 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 320/692] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:49:56 2022] GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519 => generated 1664 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:49:57.345716 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-48fd08ae-83af-497b-b00d-15b3b0c54510 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:57.346426 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-48fd08ae-83af-497b-b00d-15b3b0c54510 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: d1382aa7-6d93-410a-94ae-a7944114573f] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:57.360173 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-48fd08ae-83af-497b-b00d-15b3b0c54510 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:57.361158 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-48fd08ae-83af-497b-b00d-15b3b0c54510 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:57.362194 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-48fd08ae-83af-497b-b00d-15b3b0c54510 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:57.363390 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-48fd08ae-83af-497b-b00d-15b3b0c54510 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:57.372286 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-103f513e-259b-47d0-86b5-ef872f4a7ff6 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:57.382475 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-103f513e-259b-47d0-86b5-ef872f4a7ff6 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40" status: 200 len: 1723 microversion: 2.1 time: 0.175179 Jul 19 15:49:57.392431 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 373/693] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:49:57 2022] GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40 => generated 1723 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:49:57.513533 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-48fd08ae-83af-497b-b00d-15b3b0c54510 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7c42cf0bc84292bb0b7edb9f2e7fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a72d232f314a78b0e1c3f04b0ed682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:57.522071 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-48fd08ae-83af-497b-b00d-15b3b0c54510 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/d1382aa7-6d93-410a-94ae-a7944114573f" status: 200 len: 1556 microversion: 2.1 time: 0.181234 Jul 19 15:49:57.522683 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 321/694] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:49:57 2022] GET /compute/v2.1/servers/d1382aa7-6d93-410a-94ae-a7944114573f => generated 1556 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:49:57.541711 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-237097a8-326f-427a-8b74-2e70c3fcf8f7 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:57.542208 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-237097a8-326f-427a-8b74-2e70c3fcf8f7 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: d1382aa7-6d93-410a-94ae-a7944114573f] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:57.548402 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-237097a8-326f-427a-8b74-2e70c3fcf8f7 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:57.548850 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-237097a8-326f-427a-8b74-2e70c3fcf8f7 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:57.549608 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-237097a8-326f-427a-8b74-2e70c3fcf8f7 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:57.550045 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-237097a8-326f-427a-8b74-2e70c3fcf8f7 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:57.626031 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-237097a8-326f-427a-8b74-2e70c3fcf8f7 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/d1382aa7-6d93-410a-94ae-a7944114573f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.087821 Jul 19 15:49:57.626673 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 374/695] 10.222.0.64 () {58 vars in 1274 bytes} [Tue Jul 19 15:49:57 2022] GET /compute/v2.1/servers/d1382aa7-6d93-410a-94ae-a7944114573f/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:49:58.226135 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-25767101-e700-42a4-b506-5a5589180810 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:58.227607 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-25767101-e700-42a4-b506-5a5589180810 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: df3309b1-ba0f-4f40-937f-fc95c9c8f6a0] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:58.235655 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-25767101-e700-42a4-b506-5a5589180810 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:58.236373 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-25767101-e700-42a4-b506-5a5589180810 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:58.237433 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-25767101-e700-42a4-b506-5a5589180810 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:58.238434 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-25767101-e700-42a4-b506-5a5589180810 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:58.277323 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-853fb417-7954-4212-8da3-6692259b6043 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:58.277940 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-853fb417-7954-4212-8da3-6692259b6043 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 343ae383-5bfd-4c70-8926-a800fcee3519] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:58.292380 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-853fb417-7954-4212-8da3-6692259b6043 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:58.293018 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-853fb417-7954-4212-8da3-6692259b6043 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:58.299502 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-853fb417-7954-4212-8da3-6692259b6043 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:58.299959 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-853fb417-7954-4212-8da3-6692259b6043 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:58.363840 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG dbcounter [-] [129520] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:49:58.435012 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-25767101-e700-42a4-b506-5a5589180810 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:58.448222 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-25767101-e700-42a4-b506-5a5589180810 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:58.451861 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-25767101-e700-42a4-b506-5a5589180810 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:58.454590 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-25767101-e700-42a4-b506-5a5589180810 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0" status: 200 len: 1408 microversion: 2.20 time: 0.232333 Jul 19 15:49:58.461096 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 322/696] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:49:58 2022] GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0 => generated 1408 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:49:58.472253 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [req-83c333db-a380-4415-b2d4-928097d5f3c9 req-a8bc04de-2616-4e97-a63a-8de1b6fb6ad7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df3309b1-ba0f-4f40-937f-fc95c9c8f6a0", "name": "network-vif-plugged", "status": "completed", "tag": "f79bc5b8-5b78-4990-ae5f-977bb42032bd"}]} {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:49:58.482657 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [req-83c333db-a380-4415-b2d4-928097d5f3c9 req-a8bc04de-2616-4e97-a63a-8de1b6fb6ad7 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:58.483097 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [req-83c333db-a380-4415-b2d4-928097d5f3c9 req-a8bc04de-2616-4e97-a63a-8de1b6fb6ad7 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:58.501395 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.compute.server_external_events [req-83c333db-a380-4415-b2d4-928097d5f3c9 req-a8bc04de-2616-4e97-a63a-8de1b6fb6ad7 service nova] Creating event network-vif-plugged:f79bc5b8-5b78-4990-ae5f-977bb42032bd for instance df3309b1-ba0f-4f40-937f-fc95c9c8f6a0 on hv-cinder-84902 Jul 19 15:49:58.510943 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [req-83c333db-a380-4415-b2d4-928097d5f3c9 req-a8bc04de-2616-4e97-a63a-8de1b6fb6ad7 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048241 Jul 19 15:49:58.511567 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 323/697] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Jul 19 15:49:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:49:58.516864 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-35091270-10e5-4869-8229-be7f50973495 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:58.518940 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-35091270-10e5-4869-8229-be7f50973495 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 0194ecf2-5e08-49b2-a4e9-185bf9b32e40] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:58.546454 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-35091270-10e5-4869-8229-be7f50973495 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:58.547548 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-35091270-10e5-4869-8229-be7f50973495 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:58.549196 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-35091270-10e5-4869-8229-be7f50973495 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:58.549816 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-35091270-10e5-4869-8229-be7f50973495 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:58.575152 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-853fb417-7954-4212-8da3-6692259b6043 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c75043813844d79fd0764132dfe4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e234f713b40cd8772372c2316dd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:58.586347 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-853fb417-7954-4212-8da3-6692259b6043 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519" status: 200 len: 1664 microversion: 2.1 time: 0.312122 Jul 19 15:49:58.588951 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 375/698] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:49:58 2022] GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519 => generated 1664 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:49:58.793977 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-35091270-10e5-4869-8229-be7f50973495 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:58.803431 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-35091270-10e5-4869-8229-be7f50973495 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40" status: 200 len: 1723 microversion: 2.1 time: 0.290012 Jul 19 15:49:58.803540 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 324/699] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:49:58 2022] GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40 => generated 1723 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:49:58.971070 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [req-36377422-65ab-4862-bd0b-479dd73e53fc req-09857483-2765-41a8-9680-96ee8392781b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d1382aa7-6d93-410a-94ae-a7944114573f", "tag": "baf9abd3-9c5d-45c3-81b3-843072591796"}]} {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:49:58.979544 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [req-36377422-65ab-4862-bd0b-479dd73e53fc req-09857483-2765-41a8-9680-96ee8392781b service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:58.980012 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [req-36377422-65ab-4862-bd0b-479dd73e53fc req-09857483-2765-41a8-9680-96ee8392781b service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:58.991447 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.compute.server_external_events [req-36377422-65ab-4862-bd0b-479dd73e53fc req-09857483-2765-41a8-9680-96ee8392781b service nova] Creating event network-changed:baf9abd3-9c5d-45c3-81b3-843072591796 for instance d1382aa7-6d93-410a-94ae-a7944114573f on hv-cinder-84902 Jul 19 15:49:58.996210 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [req-36377422-65ab-4862-bd0b-479dd73e53fc req-09857483-2765-41a8-9680-96ee8392781b service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029614 Jul 19 15:49:58.996792 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 376/700] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Jul 19 15:49:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:49:59.472958 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-08146856-467b-485c-b02a-6e213faf22be tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:59.473576 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-08146856-467b-485c-b02a-6e213faf22be tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: df3309b1-ba0f-4f40-937f-fc95c9c8f6a0] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:59.479934 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-08146856-467b-485c-b02a-6e213faf22be tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:59.480375 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-08146856-467b-485c-b02a-6e213faf22be tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:59.481130 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-08146856-467b-485c-b02a-6e213faf22be tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:59.481562 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-08146856-467b-485c-b02a-6e213faf22be tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:59.605696 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-a09204fe-fb1c-4145-ac76-70f476f46acb tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:59.607103 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-a09204fe-fb1c-4145-ac76-70f476f46acb tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 343ae383-5bfd-4c70-8926-a800fcee3519] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:59.616004 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-a09204fe-fb1c-4145-ac76-70f476f46acb tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:59.616782 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-a09204fe-fb1c-4145-ac76-70f476f46acb tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:59.617978 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-a09204fe-fb1c-4145-ac76-70f476f46acb tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:59.618663 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-a09204fe-fb1c-4145-ac76-70f476f46acb tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:59.709625 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-08146856-467b-485c-b02a-6e213faf22be tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:59.723503 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-08146856-467b-485c-b02a-6e213faf22be tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:59.742464 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-08146856-467b-485c-b02a-6e213faf22be tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:59.753305 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-08146856-467b-485c-b02a-6e213faf22be tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0" status: 200 len: 1408 microversion: 2.20 time: 0.279339 Jul 19 15:49:59.760901 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 325/701] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:49:59 2022] GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0 => generated 1408 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:49:59.820048 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-28dfde53-23b5-4475-91f4-e8c45525aaa1 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:49:59.820655 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-28dfde53-23b5-4475-91f4-e8c45525aaa1 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 0194ecf2-5e08-49b2-a4e9-185bf9b32e40] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:49:59.826736 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-28dfde53-23b5-4475-91f4-e8c45525aaa1 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:59.827183 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-28dfde53-23b5-4475-91f4-e8c45525aaa1 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:59.827947 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-28dfde53-23b5-4475-91f4-e8c45525aaa1 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:49:59.829100 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-28dfde53-23b5-4475-91f4-e8c45525aaa1 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:49:59.831550 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-a09204fe-fb1c-4145-ac76-70f476f46acb tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c75043813844d79fd0764132dfe4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e234f713b40cd8772372c2316dd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:59.840156 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-a09204fe-fb1c-4145-ac76-70f476f46acb tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519" status: 200 len: 1664 microversion: 2.1 time: 0.239203 Jul 19 15:49:59.841148 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 377/702] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:49:59 2022] GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519 => generated 1664 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:49:59.977738 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-28dfde53-23b5-4475-91f4-e8c45525aaa1 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:49:59.987436 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-28dfde53-23b5-4475-91f4-e8c45525aaa1 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40" status: 200 len: 1729 microversion: 2.1 time: 0.171153 Jul 19 15:49:59.988086 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 326/703] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:49:59 2022] GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40 => generated 1729 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:50:00.004448 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-27affe6f-b510-40b3-912b-2fa180b38742 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:50:00.005242 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-27affe6f-b510-40b3-912b-2fa180b38742 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 0194ecf2-5e08-49b2-a4e9-185bf9b32e40] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:50:00.007282 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG dbcounter [-] [129520] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=129520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:50:00.013831 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-27affe6f-b510-40b3-912b-2fa180b38742 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:00.014385 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-27affe6f-b510-40b3-912b-2fa180b38742 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:00.015371 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-27affe6f-b510-40b3-912b-2fa180b38742 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:00.015840 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-27affe6f-b510-40b3-912b-2fa180b38742 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:00.132996 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-27affe6f-b510-40b3-912b-2fa180b38742 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.132601 Jul 19 15:50:00.133813 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 378/704] 10.222.0.64 () {58 vars in 1274 bytes} [Tue Jul 19 15:49:59 2022] GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40/os-interface => generated 285 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:50:00.780823 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-a4372d99-345c-4341-a795-d662fadbaf49 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:50:00.781815 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-a4372d99-345c-4341-a795-d662fadbaf49 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: df3309b1-ba0f-4f40-937f-fc95c9c8f6a0] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:50:00.788361 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-a4372d99-345c-4341-a795-d662fadbaf49 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:00.789059 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-a4372d99-345c-4341-a795-d662fadbaf49 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:00.789809 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-a4372d99-345c-4341-a795-d662fadbaf49 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:00.790238 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-a4372d99-345c-4341-a795-d662fadbaf49 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:00.860914 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-73b7c270-8b20-479d-a4e1-5a4c78a3d7c5 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:50:00.862200 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-73b7c270-8b20-479d-a4e1-5a4c78a3d7c5 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 343ae383-5bfd-4c70-8926-a800fcee3519] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:50:00.869656 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-73b7c270-8b20-479d-a4e1-5a4c78a3d7c5 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:00.870185 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-73b7c270-8b20-479d-a4e1-5a4c78a3d7c5 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:00.871006 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-73b7c270-8b20-479d-a4e1-5a4c78a3d7c5 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:00.871442 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-73b7c270-8b20-479d-a4e1-5a4c78a3d7c5 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:01.025539 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-a4372d99-345c-4341-a795-d662fadbaf49 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:50:01.035972 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-a4372d99-345c-4341-a795-d662fadbaf49 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:50:01.037950 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-a4372d99-345c-4341-a795-d662fadbaf49 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:50:01.039713 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-a4372d99-345c-4341-a795-d662fadbaf49 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0" status: 200 len: 1601 microversion: 2.20 time: 0.262822 Jul 19 15:50:01.040857 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 327/705] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:50:00 2022] GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0 => generated 1601 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:50:01.058288 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-136a2000-f004-4208-a8f5-04d1b83ff467 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:50:01.058827 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-136a2000-f004-4208-a8f5-04d1b83ff467 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: df3309b1-ba0f-4f40-937f-fc95c9c8f6a0] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:50:01.065621 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-136a2000-f004-4208-a8f5-04d1b83ff467 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:01.066073 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-136a2000-f004-4208-a8f5-04d1b83ff467 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:01.066884 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-136a2000-f004-4208-a8f5-04d1b83ff467 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:01.067323 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-136a2000-f004-4208-a8f5-04d1b83ff467 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:01.124061 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-73b7c270-8b20-479d-a4e1-5a4c78a3d7c5 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c75043813844d79fd0764132dfe4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e234f713b40cd8772372c2316dd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:50:01.132583 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-73b7c270-8b20-479d-a4e1-5a4c78a3d7c5 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519" status: 200 len: 1664 microversion: 2.1 time: 0.279331 Jul 19 15:50:01.133169 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 379/706] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:50:00 2022] GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519 => generated 1664 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:50:01.167822 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-136a2000-f004-4208-a8f5-04d1b83ff467 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.113364 Jul 19 15:50:01.168731 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 328/707] 10.222.0.64 () {60 vars in 1315 bytes} [Tue Jul 19 15:50:01 2022] GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0/os-interface => generated 285 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 19 15:50:01.416551 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [req-1364193b-45ea-456a-97ad-bb602a27533e req-6bf4de6d-af32-4f07-ba00-a39e9df5a4cc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0194ecf2-5e08-49b2-a4e9-185bf9b32e40", "tag": "588a9a7a-f29d-40a2-abf8-161404100f96"}]} {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:50:01.430644 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [req-1364193b-45ea-456a-97ad-bb602a27533e req-6bf4de6d-af32-4f07-ba00-a39e9df5a4cc service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:01.431090 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [req-1364193b-45ea-456a-97ad-bb602a27533e req-6bf4de6d-af32-4f07-ba00-a39e9df5a4cc service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:01.444099 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.compute.server_external_events [req-1364193b-45ea-456a-97ad-bb602a27533e req-6bf4de6d-af32-4f07-ba00-a39e9df5a4cc service nova] Creating event network-changed:588a9a7a-f29d-40a2-abf8-161404100f96 for instance 0194ecf2-5e08-49b2-a4e9-185bf9b32e40 on hv-cinder-84902 Jul 19 15:50:01.450517 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [req-1364193b-45ea-456a-97ad-bb602a27533e req-6bf4de6d-af32-4f07-ba00-a39e9df5a4cc service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037666 Jul 19 15:50:01.451448 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 380/708] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Jul 19 15:50:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:50:02.150738 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-15b82d96-dbd4-400a-87b2-dad3e8738ed9 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:50:02.151292 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-15b82d96-dbd4-400a-87b2-dad3e8738ed9 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 343ae383-5bfd-4c70-8926-a800fcee3519] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:50:02.167867 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-15b82d96-dbd4-400a-87b2-dad3e8738ed9 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:02.168600 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-15b82d96-dbd4-400a-87b2-dad3e8738ed9 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:02.169591 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-15b82d96-dbd4-400a-87b2-dad3e8738ed9 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:02.170253 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-15b82d96-dbd4-400a-87b2-dad3e8738ed9 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:02.360710 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-15b82d96-dbd4-400a-87b2-dad3e8738ed9 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c75043813844d79fd0764132dfe4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e234f713b40cd8772372c2316dd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:50:02.373666 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-15b82d96-dbd4-400a-87b2-dad3e8738ed9 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519" status: 200 len: 1668 microversion: 2.1 time: 0.227065 Jul 19 15:50:02.374658 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 329/709] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:50:02 2022] GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519 => generated 1668 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:50:03.510108 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [req-624e042a-ba3d-4bbb-b431-7fd7ea2e3742 req-2651dcdd-6881-4a51-bbc3-40cf3c67658a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0194ecf2-5e08-49b2-a4e9-185bf9b32e40", "tag": "588a9a7a-f29d-40a2-abf8-161404100f96"}, {"name": "network-changed", "server_uuid": "df3309b1-ba0f-4f40-937f-fc95c9c8f6a0", "tag": "f79bc5b8-5b78-4990-ae5f-977bb42032bd"}]} {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:50:03.521232 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [req-624e042a-ba3d-4bbb-b431-7fd7ea2e3742 req-2651dcdd-6881-4a51-bbc3-40cf3c67658a service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:03.521681 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [req-624e042a-ba3d-4bbb-b431-7fd7ea2e3742 req-2651dcdd-6881-4a51-bbc3-40cf3c67658a service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:03.534406 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.compute.server_external_events [req-624e042a-ba3d-4bbb-b431-7fd7ea2e3742 req-2651dcdd-6881-4a51-bbc3-40cf3c67658a service nova] Creating event network-changed:588a9a7a-f29d-40a2-abf8-161404100f96 for instance 0194ecf2-5e08-49b2-a4e9-185bf9b32e40 on hv-cinder-84902 Jul 19 15:50:03.534901 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.compute.server_external_events [req-624e042a-ba3d-4bbb-b431-7fd7ea2e3742 req-2651dcdd-6881-4a51-bbc3-40cf3c67658a service nova] Creating event network-changed:f79bc5b8-5b78-4990-ae5f-977bb42032bd for instance df3309b1-ba0f-4f40-937f-fc95c9c8f6a0 on hv-cinder-84902 Jul 19 15:50:03.541403 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [req-624e042a-ba3d-4bbb-b431-7fd7ea2e3742 req-2651dcdd-6881-4a51-bbc3-40cf3c67658a service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.035776 Jul 19 15:50:03.542006 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 381/710] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Jul 19 15:50:03 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:50:23.607150 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 15:50:23.607581 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Tue Jul 19 15:50:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 15:50:40.154093 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-edb3c6ff-f6d0-4990-8bce-46c1660bdb56 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:50:40.154747 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-edb3c6ff-f6d0-4990-8bce-46c1660bdb56 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 0194ecf2-5e08-49b2-a4e9-185bf9b32e40] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:50:40.157492 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG dbcounter [-] [129519] Writing DB stats nova_api:SELECT=25 {{(pid=129519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:50:40.158077 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG dbcounter [-] [129519] Writing DB stats nova_cell1:UPDATE=1,nova_cell1:SELECT=82,nova_cell1:INSERT=1 {{(pid=129519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:50:40.163798 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-edb3c6ff-f6d0-4990-8bce-46c1660bdb56 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:40.164511 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-edb3c6ff-f6d0-4990-8bce-46c1660bdb56 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:40.165269 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-edb3c6ff-f6d0-4990-8bce-46c1660bdb56 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:40.165709 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-edb3c6ff-f6d0-4990-8bce-46c1660bdb56 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:40.361947 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.objects.instance [None req-edb3c6ff-f6d0-4990-8bce-46c1660bdb56 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lazy-loading 'services' on Instance uuid 0194ecf2-5e08-49b2-a4e9-185bf9b32e40 {{(pid=129519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 15:50:40.432574 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-edb3c6ff-f6d0-4990-8bce-46c1660bdb56 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "DELETE /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40/os-volume_attachments/b0fb4360-eb9d-4a23-87ae-d1f240088e56" status: 202 len: 0 microversion: 2.1 time: 0.282355 Jul 19 15:50:40.433213 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 330/711] 10.222.0.64 () {58 vars in 1415 bytes} [Tue Jul 19 15:50:40 2022] DELETE /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40/os-volume_attachments/b0fb4360-eb9d-4a23-87ae-d1f240088e56 => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 15:50:40.440388 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG dbcounter [-] [129520] Writing DB stats nova_api:SELECT=7 {{(pid=129520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:50:40.441119 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG dbcounter [-] [129520] Writing DB stats nova_cell1:SELECT=25 {{(pid=129520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:50:40.445382 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-e3b64b2d-ce28-4d28-b97d-26cbdf274cb7 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:50:40.446398 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-e3b64b2d-ce28-4d28-b97d-26cbdf274cb7 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 0194ecf2-5e08-49b2-a4e9-185bf9b32e40] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:50:40.454203 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-e3b64b2d-ce28-4d28-b97d-26cbdf274cb7 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:40.454668 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-e3b64b2d-ce28-4d28-b97d-26cbdf274cb7 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:40.455423 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-e3b64b2d-ce28-4d28-b97d-26cbdf274cb7 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:40.455859 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-e3b64b2d-ce28-4d28-b97d-26cbdf274cb7 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:40.487380 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-e3b64b2d-ce28-4d28-b97d-26cbdf274cb7 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048779 Jul 19 15:50:40.488072 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 382/712] 10.222.0.64 () {58 vars in 1301 bytes} [Tue Jul 19 15:50:40 2022] GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:50:41.497656 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-aa08f316-8f8c-4884-9cbe-f5cc77489065 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:50:41.498814 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-aa08f316-8f8c-4884-9cbe-f5cc77489065 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 343ae383-5bfd-4c70-8926-a800fcee3519] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:50:41.498944 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-e70e80b6-83f4-4bd5-b0c3-d9ffbe23c35c tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:50:41.499850 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-e70e80b6-83f4-4bd5-b0c3-d9ffbe23c35c tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 0194ecf2-5e08-49b2-a4e9-185bf9b32e40] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:50:41.505345 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-aa08f316-8f8c-4884-9cbe-f5cc77489065 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:41.505798 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-aa08f316-8f8c-4884-9cbe-f5cc77489065 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:41.506393 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-e70e80b6-83f4-4bd5-b0c3-d9ffbe23c35c tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:41.506595 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-aa08f316-8f8c-4884-9cbe-f5cc77489065 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:41.506838 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-e70e80b6-83f4-4bd5-b0c3-d9ffbe23c35c tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:41.507035 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-aa08f316-8f8c-4884-9cbe-f5cc77489065 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:41.507584 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-e70e80b6-83f4-4bd5-b0c3-d9ffbe23c35c tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:41.508013 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-e70e80b6-83f4-4bd5-b0c3-d9ffbe23c35c tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:41.536876 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-aa08f316-8f8c-4884-9cbe-f5cc77489065 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044249 Jul 19 15:50:41.537205 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-e70e80b6-83f4-4bd5-b0c3-d9ffbe23c35c tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042139 Jul 19 15:50:41.537438 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 331/713] 10.222.0.64 () {58 vars in 1301 bytes} [Tue Jul 19 15:50:41 2022] GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 15:50:41.537758 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 383/714] 10.222.0.64 () {58 vars in 1301 bytes} [Tue Jul 19 15:50:41 2022] GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 19 15:50:41.596885 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-b9228931-2266-4d07-943e-bff40f816430 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:50:41.597377 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-b9228931-2266-4d07-943e-bff40f816430 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 343ae383-5bfd-4c70-8926-a800fcee3519] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:50:41.603490 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-b9228931-2266-4d07-943e-bff40f816430 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:41.603972 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-b9228931-2266-4d07-943e-bff40f816430 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:41.604701 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-b9228931-2266-4d07-943e-bff40f816430 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:41.605137 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-b9228931-2266-4d07-943e-bff40f816430 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:41.612019 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-35ffb770-4dd0-4799-9b8e-3f1ebaaac203 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:50:41.612491 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-35ffb770-4dd0-4799-9b8e-3f1ebaaac203 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 0194ecf2-5e08-49b2-a4e9-185bf9b32e40] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:50:41.618656 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-35ffb770-4dd0-4799-9b8e-3f1ebaaac203 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:41.619164 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-35ffb770-4dd0-4799-9b8e-3f1ebaaac203 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:41.619962 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-35ffb770-4dd0-4799-9b8e-3f1ebaaac203 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:41.620429 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-35ffb770-4dd0-4799-9b8e-3f1ebaaac203 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:41.632443 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-b9228931-2266-4d07-943e-bff40f816430 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 343ae383-5bfd-4c70-8926-a800fcee3519] Going to try to terminate instance {{(pid=129519) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 15:50:41.647005 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-35ffb770-4dd0-4799-9b8e-3f1ebaaac203 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 0194ecf2-5e08-49b2-a4e9-185bf9b32e40] Going to try to terminate instance {{(pid=129520) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 15:50:41.720214 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-b9228931-2266-4d07-943e-bff40f816430 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "DELETE /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519" status: 204 len: 0 microversion: 2.1 time: 0.126762 Jul 19 15:50:41.725077 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 332/715] 10.222.0.64 () {58 vars in 1238 bytes} [Tue Jul 19 15:50:41 2022] DELETE /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 15:50:41.729701 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-35ffb770-4dd0-4799-9b8e-3f1ebaaac203 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "DELETE /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40" status: 204 len: 0 microversion: 2.1 time: 0.121386 Jul 19 15:50:41.730389 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 384/716] 10.222.0.64 () {58 vars in 1238 bytes} [Tue Jul 19 15:50:41 2022] DELETE /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 19 15:50:41.731369 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-b3883032-ea43-4b02-ba84-432ee54e0a65 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:50:41.732100 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-b3883032-ea43-4b02-ba84-432ee54e0a65 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 343ae383-5bfd-4c70-8926-a800fcee3519] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:50:41.738741 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-21d8af1b-bb46-4270-bf4c-051e1cef5be2 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:50:41.739432 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-21d8af1b-bb46-4270-bf4c-051e1cef5be2 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 0194ecf2-5e08-49b2-a4e9-185bf9b32e40] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:50:41.739554 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-b3883032-ea43-4b02-ba84-432ee54e0a65 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:41.739958 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-b3883032-ea43-4b02-ba84-432ee54e0a65 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:41.740731 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-b3883032-ea43-4b02-ba84-432ee54e0a65 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:41.741170 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-b3883032-ea43-4b02-ba84-432ee54e0a65 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:41.745296 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-21d8af1b-bb46-4270-bf4c-051e1cef5be2 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:41.745748 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-21d8af1b-bb46-4270-bf4c-051e1cef5be2 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:41.746561 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-21d8af1b-bb46-4270-bf4c-051e1cef5be2 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:41.747080 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-21d8af1b-bb46-4270-bf4c-051e1cef5be2 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:41.874181 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-b3883032-ea43-4b02-ba84-432ee54e0a65 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c75043813844d79fd0764132dfe4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e234f713b40cd8772372c2316dd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:50:41.882753 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-b3883032-ea43-4b02-ba84-432ee54e0a65 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519" status: 200 len: 1674 microversion: 2.1 time: 0.156029 Jul 19 15:50:41.883309 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 333/717] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:50:41 2022] GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519 => generated 1674 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:50:41.979701 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-21d8af1b-bb46-4270-bf4c-051e1cef5be2 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:50:41.987787 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-21d8af1b-bb46-4270-bf4c-051e1cef5be2 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40" status: 200 len: 1689 microversion: 2.1 time: 0.253019 Jul 19 15:50:41.988356 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 385/718] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:50:41 2022] GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40 => generated 1689 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:50:42.900306 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-977d382b-d816-4de8-9cb9-da3519cf8729 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:50:42.900966 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-977d382b-d816-4de8-9cb9-da3519cf8729 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 343ae383-5bfd-4c70-8926-a800fcee3519] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:50:42.907609 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-977d382b-d816-4de8-9cb9-da3519cf8729 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:42.908059 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-977d382b-d816-4de8-9cb9-da3519cf8729 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:42.908817 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-977d382b-d816-4de8-9cb9-da3519cf8729 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:42.909252 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-977d382b-d816-4de8-9cb9-da3519cf8729 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:43.005374 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-370db543-d010-4ee3-bcd9-481cdd57d266 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:50:43.005987 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-370db543-d010-4ee3-bcd9-481cdd57d266 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 0194ecf2-5e08-49b2-a4e9-185bf9b32e40] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:50:43.012653 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-370db543-d010-4ee3-bcd9-481cdd57d266 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:43.013101 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-370db543-d010-4ee3-bcd9-481cdd57d266 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:43.013868 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-370db543-d010-4ee3-bcd9-481cdd57d266 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:43.014307 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-370db543-d010-4ee3-bcd9-481cdd57d266 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:43.054690 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-977d382b-d816-4de8-9cb9-da3519cf8729 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c75043813844d79fd0764132dfe4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e234f713b40cd8772372c2316dd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:50:43.063314 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-977d382b-d816-4de8-9cb9-da3519cf8729 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519" status: 200 len: 1674 microversion: 2.1 time: 0.165893 Jul 19 15:50:43.064105 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 334/719] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:50:42 2022] GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519 => generated 1674 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:50:43.142662 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-370db543-d010-4ee3-bcd9-481cdd57d266 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:50:43.150083 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-370db543-d010-4ee3-bcd9-481cdd57d266 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40" status: 200 len: 1689 microversion: 2.1 time: 0.149054 Jul 19 15:50:43.150690 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 386/720] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:50:42 2022] GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40 => generated 1689 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:50:43.519325 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-d990b525-9d95-496a-b990-b97f7cf56418 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:50:43.519810 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-d990b525-9d95-496a-b990-b97f7cf56418 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: d1382aa7-6d93-410a-94ae-a7944114573f] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:50:43.525793 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-d990b525-9d95-496a-b990-b97f7cf56418 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:43.526236 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-d990b525-9d95-496a-b990-b97f7cf56418 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:43.527017 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-d990b525-9d95-496a-b990-b97f7cf56418 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:43.527441 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-d990b525-9d95-496a-b990-b97f7cf56418 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:43.550539 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-d990b525-9d95-496a-b990-b97f7cf56418 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/d1382aa7-6d93-410a-94ae-a7944114573f/ips" status: 200 len: 150 microversion: 2.1 time: 0.136135 Jul 19 15:50:43.551072 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 335/721] 10.222.0.64 () {58 vars in 1247 bytes} [Tue Jul 19 15:50:43 2022] GET /compute/v2.1/servers/d1382aa7-6d93-410a-94ae-a7944114573f/ips => generated 150 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:50:44.080744 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-b2a23379-e743-4500-9bb1-fed3bfc71130 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:50:44.081399 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-b2a23379-e743-4500-9bb1-fed3bfc71130 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 343ae383-5bfd-4c70-8926-a800fcee3519] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:50:44.088781 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b2a23379-e743-4500-9bb1-fed3bfc71130 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:44.089375 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b2a23379-e743-4500-9bb1-fed3bfc71130 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:44.090184 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b2a23379-e743-4500-9bb1-fed3bfc71130 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:44.090638 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b2a23379-e743-4500-9bb1-fed3bfc71130 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:44.167543 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-ee0649d7-446f-45f8-886c-ee8f9a59b2de tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:50:44.168159 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-ee0649d7-446f-45f8-886c-ee8f9a59b2de tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 0194ecf2-5e08-49b2-a4e9-185bf9b32e40] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:50:44.175699 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-ee0649d7-446f-45f8-886c-ee8f9a59b2de tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:44.176155 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-ee0649d7-446f-45f8-886c-ee8f9a59b2de tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:44.176932 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-ee0649d7-446f-45f8-886c-ee8f9a59b2de tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:44.177368 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-ee0649d7-446f-45f8-886c-ee8f9a59b2de tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:44.316275 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-ee0649d7-446f-45f8-886c-ee8f9a59b2de tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:50:44.324085 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-ee0649d7-446f-45f8-886c-ee8f9a59b2de tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40" status: 200 len: 1689 microversion: 2.1 time: 0.160630 Jul 19 15:50:44.324662 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 336/722] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:50:44 2022] GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40 => generated 1689 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:50:44.457148 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-b2a23379-e743-4500-9bb1-fed3bfc71130 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c75043813844d79fd0764132dfe4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e234f713b40cd8772372c2316dd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:50:44.464468 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-b2a23379-e743-4500-9bb1-fed3bfc71130 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519" status: 200 len: 1674 microversion: 2.1 time: 0.387704 Jul 19 15:50:44.465029 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 387/723] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:50:44 2022] GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519 => generated 1674 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:50:44.870673 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-4a70f958-179c-4fb7-a019-98f02ecb50f8 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8598c3ff-d749-423a-94bc-227b82f6b4c2"}} {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:50:44.871850 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-4a70f958-179c-4fb7-a019-98f02ecb50f8 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: d1382aa7-6d93-410a-94ae-a7944114573f] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:50:44.877959 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-4a70f958-179c-4fb7-a019-98f02ecb50f8 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:44.878445 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-4a70f958-179c-4fb7-a019-98f02ecb50f8 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:44.879204 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-4a70f958-179c-4fb7-a019-98f02ecb50f8 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:44.879641 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-4a70f958-179c-4fb7-a019-98f02ecb50f8 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:45.341621 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-73d80d00-af74-4a65-b83d-f7ca88cade17 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:50:45.342269 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-73d80d00-af74-4a65-b83d-f7ca88cade17 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 0194ecf2-5e08-49b2-a4e9-185bf9b32e40] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:50:45.348524 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-73d80d00-af74-4a65-b83d-f7ca88cade17 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:45.348976 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-73d80d00-af74-4a65-b83d-f7ca88cade17 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:45.349739 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-73d80d00-af74-4a65-b83d-f7ca88cade17 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:45.350177 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-73d80d00-af74-4a65-b83d-f7ca88cade17 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:45.478688 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-73d80d00-af74-4a65-b83d-f7ca88cade17 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:50:45.486591 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-73d80d00-af74-4a65-b83d-f7ca88cade17 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40" status: 200 len: 1689 microversion: 2.1 time: 0.148787 Jul 19 15:50:45.487150 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 388/724] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:50:45 2022] GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40 => generated 1689 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:50:45.491398 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-45c362a9-b569-458c-bba6-0e3ef58e41d2 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:50:45.491987 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-45c362a9-b569-458c-bba6-0e3ef58e41d2 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 343ae383-5bfd-4c70-8926-a800fcee3519] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:50:45.497457 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-45c362a9-b569-458c-bba6-0e3ef58e41d2 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:45.497896 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-45c362a9-b569-458c-bba6-0e3ef58e41d2 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:45.498664 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-45c362a9-b569-458c-bba6-0e3ef58e41d2 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:45.499093 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-45c362a9-b569-458c-bba6-0e3ef58e41d2 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:45.634401 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-45c362a9-b569-458c-bba6-0e3ef58e41d2 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c75043813844d79fd0764132dfe4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e234f713b40cd8772372c2316dd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:50:45.642181 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-45c362a9-b569-458c-bba6-0e3ef58e41d2 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519" status: 200 len: 1674 microversion: 2.1 time: 0.154097 Jul 19 15:50:45.642794 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 389/725] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:50:45 2022] GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519 => generated 1674 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:50:46.504575 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-b1d4e10d-79a4-4d86-a2b3-f86e50c74b9e tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:50:46.505200 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-b1d4e10d-79a4-4d86-a2b3-f86e50c74b9e tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 0194ecf2-5e08-49b2-a4e9-185bf9b32e40] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:50:46.511572 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b1d4e10d-79a4-4d86-a2b3-f86e50c74b9e tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:46.512011 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b1d4e10d-79a4-4d86-a2b3-f86e50c74b9e tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:46.512767 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b1d4e10d-79a4-4d86-a2b3-f86e50c74b9e tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:46.513197 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b1d4e10d-79a4-4d86-a2b3-f86e50c74b9e tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:46.659843 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-b1d4e10d-79a4-4d86-a2b3-f86e50c74b9e tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:50:46.669316 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-b1d4e10d-79a4-4d86-a2b3-f86e50c74b9e tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40" status: 200 len: 1689 microversion: 2.1 time: 0.169069 Jul 19 15:50:46.670095 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 390/726] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:50:46 2022] GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40 => generated 1689 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:50:46.806580 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-3baacdd3-71aa-4d2b-ba39-70537a90b116 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:50:46.807088 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-3baacdd3-71aa-4d2b-ba39-70537a90b116 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: df3309b1-ba0f-4f40-937f-fc95c9c8f6a0] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:50:46.814133 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-3baacdd3-71aa-4d2b-ba39-70537a90b116 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:46.814651 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-3baacdd3-71aa-4d2b-ba39-70537a90b116 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:46.815420 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-3baacdd3-71aa-4d2b-ba39-70537a90b116 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:46.815860 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-3baacdd3-71aa-4d2b-ba39-70537a90b116 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:46.844260 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-3baacdd3-71aa-4d2b-ba39-70537a90b116 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0/ips" status: 200 len: 152 microversion: 2.20 time: 0.172514 Jul 19 15:50:46.844962 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 391/727] 10.222.0.64 () {60 vars in 1288 bytes} [Tue Jul 19 15:50:46 2022] GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0/ips => generated 152 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 15:50:46.861406 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-8cca0aaa-a81b-46a8-b66d-776e98e1509e tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:50:46.862283 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-8cca0aaa-a81b-46a8-b66d-776e98e1509e tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 343ae383-5bfd-4c70-8926-a800fcee3519] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:50:46.869884 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-8cca0aaa-a81b-46a8-b66d-776e98e1509e tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:46.870319 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-8cca0aaa-a81b-46a8-b66d-776e98e1509e tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:46.871122 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-8cca0aaa-a81b-46a8-b66d-776e98e1509e tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:46.871555 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-8cca0aaa-a81b-46a8-b66d-776e98e1509e tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:46.956423 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-4a70f958-179c-4fb7-a019-98f02ecb50f8 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "POST /compute/v2.1/servers/d1382aa7-6d93-410a-94ae-a7944114573f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.089612 Jul 19 15:50:46.957860 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 337/728] 10.222.0.64 () {60 vars in 1322 bytes} [Tue Jul 19 15:50:44 2022] POST /compute/v2.1/servers/d1382aa7-6d93-410a-94ae-a7944114573f/os-volume_attachments => generated 194 bytes in 2092 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:50:47.216870 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-8cca0aaa-a81b-46a8-b66d-776e98e1509e tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c75043813844d79fd0764132dfe4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e234f713b40cd8772372c2316dd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:50:47.225243 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-8cca0aaa-a81b-46a8-b66d-776e98e1509e tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519" status: 200 len: 1674 microversion: 2.1 time: 0.379144 Jul 19 15:50:47.226111 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 392/729] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:50:46 2022] GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519 => generated 1674 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:50:47.704946 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-0f93b5e3-cc42-4400-b75c-e75a9258c602 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:50:47.705756 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-0f93b5e3-cc42-4400-b75c-e75a9258c602 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 0194ecf2-5e08-49b2-a4e9-185bf9b32e40] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:50:47.725360 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-0f93b5e3-cc42-4400-b75c-e75a9258c602 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:47.726875 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-0f93b5e3-cc42-4400-b75c-e75a9258c602 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:47.729686 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-0f93b5e3-cc42-4400-b75c-e75a9258c602 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:47.730800 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-0f93b5e3-cc42-4400-b75c-e75a9258c602 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:47.831072 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-0f93b5e3-cc42-4400-b75c-e75a9258c602 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:50:47.838961 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-0f93b5e3-cc42-4400-b75c-e75a9258c602 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40" status: 200 len: 1621 microversion: 2.1 time: 0.147649 Jul 19 15:50:47.841918 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 338/730] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:50:47 2022] GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40 => generated 1621 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:50:48.145759 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [req-88b74d71-0fb6-4073-b2a5-c314faa30a68 req-2b10a6cd-44bb-434f-a8a9-07ca909c57ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "343ae383-5bfd-4c70-8926-a800fcee3519", "name": "network-vif-deleted", "tag": "a70da232-0d1f-4d96-ac45-c34ad79c41f8"}]} {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:50:48.162316 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [req-88b74d71-0fb6-4073-b2a5-c314faa30a68 req-2b10a6cd-44bb-434f-a8a9-07ca909c57ac service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:48.167333 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [req-88b74d71-0fb6-4073-b2a5-c314faa30a68 req-2b10a6cd-44bb-434f-a8a9-07ca909c57ac service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:48.199344 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.compute.server_external_events [req-88b74d71-0fb6-4073-b2a5-c314faa30a68 req-2b10a6cd-44bb-434f-a8a9-07ca909c57ac service nova] Creating event network-vif-deleted:a70da232-0d1f-4d96-ac45-c34ad79c41f8 for instance 343ae383-5bfd-4c70-8926-a800fcee3519 on hv-cinder-84902 Jul 19 15:50:48.208646 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [req-88b74d71-0fb6-4073-b2a5-c314faa30a68 req-2b10a6cd-44bb-434f-a8a9-07ca909c57ac service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.214194 Jul 19 15:50:48.214745 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 393/731] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Jul 19 15:50:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 15:50:48.219732 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [req-746729be-4a96-4643-a5f6-00b3627cc6fc req-7032c37d-8a20-4b54-8b62-0aa0c92a72eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0194ecf2-5e08-49b2-a4e9-185bf9b32e40", "name": "network-vif-deleted", "tag": "588a9a7a-f29d-40a2-abf8-161404100f96"}]} {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:50:48.238688 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [req-746729be-4a96-4643-a5f6-00b3627cc6fc req-7032c37d-8a20-4b54-8b62-0aa0c92a72eb service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:48.239685 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [req-746729be-4a96-4643-a5f6-00b3627cc6fc req-7032c37d-8a20-4b54-8b62-0aa0c92a72eb service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:48.245782 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-3788821d-b66a-44b5-a67d-2a8a2f064262 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:50:48.246542 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-3788821d-b66a-44b5-a67d-2a8a2f064262 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 343ae383-5bfd-4c70-8926-a800fcee3519] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:50:48.257835 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-3788821d-b66a-44b5-a67d-2a8a2f064262 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:48.258293 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-3788821d-b66a-44b5-a67d-2a8a2f064262 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:48.259222 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-3788821d-b66a-44b5-a67d-2a8a2f064262 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:48.259637 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-3788821d-b66a-44b5-a67d-2a8a2f064262 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:48.269746 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.compute.server_external_events [req-746729be-4a96-4643-a5f6-00b3627cc6fc req-7032c37d-8a20-4b54-8b62-0aa0c92a72eb service nova] Creating event network-vif-deleted:588a9a7a-f29d-40a2-abf8-161404100f96 for instance 0194ecf2-5e08-49b2-a4e9-185bf9b32e40 on hv-cinder-84902 Jul 19 15:50:48.279460 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [req-746729be-4a96-4643-a5f6-00b3627cc6fc req-7032c37d-8a20-4b54-8b62-0aa0c92a72eb service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.225981 Jul 19 15:50:48.282142 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 339/732] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Jul 19 15:50:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:50:48.339822 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-3788821d-b66a-44b5-a67d-2a8a2f064262 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:48.340859 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-3788821d-b66a-44b5-a67d-2a8a2f064262 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:48.341533 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.objects.instance [None req-3788821d-b66a-44b5-a67d-2a8a2f064262 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lazy-loading 'fault' on Instance uuid 343ae383-5bfd-4c70-8926-a800fcee3519 {{(pid=129520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 15:50:48.405352 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-3788821d-b66a-44b5-a67d-2a8a2f064262 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c75043813844d79fd0764132dfe4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e234f713b40cd8772372c2316dd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:50:48.415321 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-3788821d-b66a-44b5-a67d-2a8a2f064262 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519" status: 200 len: 1327 microversion: 2.1 time: 0.173770 Jul 19 15:50:48.425964 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 394/733] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:50:48 2022] GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519 => generated 1327 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:50:48.854121 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-18d70ab5-ad2c-4036-8e8c-0603efbd72c8 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:50:48.854976 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-18d70ab5-ad2c-4036-8e8c-0603efbd72c8 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: df3309b1-ba0f-4f40-937f-fc95c9c8f6a0] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:50:48.856741 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-92c26c71-4961-4155-abed-62ba46238ef7 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:50:48.857356 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-92c26c71-4961-4155-abed-62ba46238ef7 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 0194ecf2-5e08-49b2-a4e9-185bf9b32e40] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:50:48.871178 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-92c26c71-4961-4155-abed-62ba46238ef7 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:48.871651 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-92c26c71-4961-4155-abed-62ba46238ef7 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:48.872669 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-92c26c71-4961-4155-abed-62ba46238ef7 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:48.873266 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-92c26c71-4961-4155-abed-62ba46238ef7 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:48.876962 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-18d70ab5-ad2c-4036-8e8c-0603efbd72c8 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:48.880454 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-18d70ab5-ad2c-4036-8e8c-0603efbd72c8 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:48.881995 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-18d70ab5-ad2c-4036-8e8c-0603efbd72c8 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:48.882838 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-18d70ab5-ad2c-4036-8e8c-0603efbd72c8 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:48.894062 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.wsgi [None req-92c26c71-4961-4155-abed-62ba46238ef7 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] HTTP exception thrown: Instance 0194ecf2-5e08-49b2-a4e9-185bf9b32e40 could not be found. Jul 19 15:50:48.903301 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-92c26c71-4961-4155-abed-62ba46238ef7 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Request method failure captured: Jul 19 15:50:48.903301 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: request: GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40 HTTP/1.1 Jul 19 15:50:48.903301 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Accept: application/json Jul 19 15:50:48.903301 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Accept-Encoding: identity Jul 19 15:50:48.903301 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Connection: close Jul 19 15:50:48.903301 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Content-Length: 0 Jul 19 15:50:48.903301 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Content-Type: application/json Jul 19 15:50:48.903301 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Host: 10.222.0.64 Jul 19 15:50:48.903301 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Openstack-System-Scope: None Jul 19 15:50:48.903301 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: User-Agent: python-urllib3/1.26.9 Jul 19 15:50:48.903301 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Auth-Token: gAAAAABi1tGPG3TL2GwfAc0kf5LaV9cX4pbJFxTWqQKwJFE5MwZWkdPruymWghvL56VHYnPjmTX00Dxb6n-I5a-K8qDlTUL3Rdjijr9hGViaVz0EvfiTyEi0NIlocc44JNIONZOhLldSNTzzdFWiWGRLTkuRKHFmrDA7ImfJvTM2riB9cOts4j4 Jul 19 15:50:48.903301 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Domain-Id: None Jul 19 15:50:48.903301 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Domain-Name: None Jul 19 15:50:48.903301 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Identity-Status: Confirmed Jul 19 15:50:48.903301 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Is-Admin-Project: True Jul 19 15:50:48.903301 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Project-Domain-Id: default Jul 19 15:50:48.903301 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Project-Domain-Name: Default Jul 19 15:50:48.903301 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Project-Id: a872b4eafae74b82896bd09229152104 Jul 19 15:50:48.903301 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1658676 Jul 19 15:50:48.903301 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Role: member,reader Jul 19 15:50:48.903301 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Roles: member,reader Jul 19 15:50:48.904777 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_a872b4eafae74b82896bd09229152104", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a872b4eafae74b82896bd09229152104"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a872b4eafae74b82896bd09229152104"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/a872b4eafae74b82896bd09229152104"}]}] Jul 19 15:50:48.904777 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1658676 Jul 19 15:50:48.904777 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Tenant-Id: a872b4eafae74b82896bd09229152104 Jul 19 15:50:48.904777 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1658676 Jul 19 15:50:48.904777 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User: tempest-ServerRescueNegativeTestJSON-1658676-project Jul 19 15:50:48.904777 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User-Domain-Id: default Jul 19 15:50:48.904777 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User-Domain-Name: Default Jul 19 15:50:48.904777 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User-Id: 4785719411fd4af892868d99fca7cd71 Jul 19 15:50:48.904777 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1658676-project Jul 19 15:50:48.904777 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: method: > Jul 19 15:50:48.904777 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: exception: Instance 0194ecf2-5e08-49b2-a4e9-185bf9b32e40 could not be found. Jul 19 15:50:48.904777 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: action_args: {'id': '0194ecf2-5e08-49b2-a4e9-185bf9b32e40'} Jul 19 15:50:48.905521 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:50:48.905521 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:50:48.905521 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 15:50:48.905521 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 15:50:48.905521 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 15:50:48.905521 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 15:50:48.905521 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 15:50:48.905521 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 15:50:48.905521 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 15:50:48.905521 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 15:50:48.905521 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0194ecf2-5e08-49b2-a4e9-185bf9b32e40 could not be found. Jul 19 15:50:48.905521 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:50:48.905521 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:50:48.905521 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:50:48.905521 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:50:48.905521 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:50:48.905521 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:50:48.905521 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:50:48.905521 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:50:48.905521 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:50:48.907810 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:50:48.907810 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 15:50:48.907810 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 15:50:48.907810 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 15:50:48.907810 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 15:50:48.907810 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 15:50:48.907810 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 15:50:48.907810 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0194ecf2-5e08-49b2-a4e9-185bf9b32e40 could not be found. Jul 19 15:50:48.907810 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:50:48.907810 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:50:48.907810 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:50:48.907810 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:50:48.907810 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:50:48.907810 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:50:48.907810 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:50:48.907810 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:50:48.907810 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0194ecf2-5e08-49b2-a4e9-185bf9b32e40 could not be found. Jul 19 15:50:48.907810 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:50:48.908945 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-92c26c71-4961-4155-abed-62ba46238ef7 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Returning 404 to user: Instance 0194ecf2-5e08-49b2-a4e9-185bf9b32e40 could not be found. {{(pid=129520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:50:48.908945 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-92c26c71-4961-4155-abed-62ba46238ef7 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40" status: 404 len: 111 microversion: 2.1 time: 0.052135 Jul 19 15:50:48.909116 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 395/734] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:50:48 2022] GET /compute/v2.1/servers/0194ecf2-5e08-49b2-a4e9-185bf9b32e40 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 15:50:48.919902 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.objects.instance [None req-18d70ab5-ad2c-4036-8e8c-0603efbd72c8 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lazy-loading 'flavor' on Instance uuid df3309b1-ba0f-4f40-937f-fc95c9c8f6a0 {{(pid=129519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 15:50:48.921534 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-d4ae3864-7705-473d-9d74-835e74a1687a tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '.version_select at 0x7fb8a5a62160>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:50:48.942843 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-d4ae3864-7705-473d-9d74-835e74a1687a tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-803221286" status: 202 len: 0 microversion: 2.1 time: 0.032165 Jul 19 15:50:48.943427 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 396/735] 10.222.0.64 () {58 vars in 1217 bytes} [Tue Jul 19 15:50:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-803221286 => generated 0 bytes in 34 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 15:50:49.278158 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-18d70ab5-ad2c-4036-8e8c-0603efbd72c8 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "POST /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0/action" status: 202 len: 0 microversion: 2.20 time: 0.436563 Jul 19 15:50:49.282418 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 340/736] 10.222.0.64 () {62 vars in 1318 bytes} [Tue Jul 19 15:50:48 2022] POST /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0/action => generated 0 bytes in 440 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 19 15:50:49.293760 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-23040751-e934-4f57-a90a-23ec3ca4ccd9 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:50:49.294447 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-23040751-e934-4f57-a90a-23ec3ca4ccd9 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: df3309b1-ba0f-4f40-937f-fc95c9c8f6a0] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:50:49.305736 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-23040751-e934-4f57-a90a-23ec3ca4ccd9 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:49.306556 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-23040751-e934-4f57-a90a-23ec3ca4ccd9 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:49.307538 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-23040751-e934-4f57-a90a-23ec3ca4ccd9 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:49.308136 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-23040751-e934-4f57-a90a-23ec3ca4ccd9 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:49.441421 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-e1c023e2-65f1-4c6a-8674-d0165671a115 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:50:49.442121 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-e1c023e2-65f1-4c6a-8674-d0165671a115 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 343ae383-5bfd-4c70-8926-a800fcee3519] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:50:49.456940 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-e1c023e2-65f1-4c6a-8674-d0165671a115 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:49.457303 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-e1c023e2-65f1-4c6a-8674-d0165671a115 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:49.458265 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-e1c023e2-65f1-4c6a-8674-d0165671a115 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:49.470089 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-e1c023e2-65f1-4c6a-8674-d0165671a115 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:49.477654 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-23040751-e934-4f57-a90a-23ec3ca4ccd9 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:50:49.488547 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-23040751-e934-4f57-a90a-23ec3ca4ccd9 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:50:49.490584 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.wsgi [None req-e1c023e2-65f1-4c6a-8674-d0165671a115 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] HTTP exception thrown: Instance 343ae383-5bfd-4c70-8926-a800fcee3519 could not be found. Jul 19 15:50:49.491477 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-23040751-e934-4f57-a90a-23ec3ca4ccd9 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:50:49.492240 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-e1c023e2-65f1-4c6a-8674-d0165671a115 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Request method failure captured: Jul 19 15:50:49.492240 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: request: GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519 HTTP/1.1 Jul 19 15:50:49.492240 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Accept: application/json Jul 19 15:50:49.492240 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Accept-Encoding: identity Jul 19 15:50:49.492240 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Connection: close Jul 19 15:50:49.492240 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Content-Length: 0 Jul 19 15:50:49.492240 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Content-Type: application/json Jul 19 15:50:49.492240 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Host: 10.222.0.64 Jul 19 15:50:49.492240 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Openstack-System-Scope: None Jul 19 15:50:49.492240 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: User-Agent: python-urllib3/1.26.9 Jul 19 15:50:49.492240 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Auth-Token: gAAAAABi1tHeLm_LCBzz_Bg1FiUDtORDWFTPGXbpVJ2F6BGM4Zy_92gr2D50Ra8q_u960WvBhCTil5fIiRYXEiS_zgjeLu0y-flWKNola3MXcZpujx3jZswBWC8yY0g6OsKKmKOHe7r4WW6pan3Q3AW0Ymh_hKdosZEzin5vW0GmEeXr7WYkyxw Jul 19 15:50:49.492240 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Domain-Id: None Jul 19 15:50:49.492240 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Domain-Name: None Jul 19 15:50:49.492240 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Identity-Status: Confirmed Jul 19 15:50:49.492240 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Is-Admin-Project: True Jul 19 15:50:49.492240 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Domain-Id: default Jul 19 15:50:49.492240 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Domain-Name: Default Jul 19 15:50:49.492240 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Id: e11e234f713b40cd8772372c2316dd28 Jul 19 15:50:49.492240 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Name: tempest-AttachVolumeTestJSON-1928423787 Jul 19 15:50:49.492240 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Role: member,reader Jul 19 15:50:49.492240 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Roles: member,reader Jul 19 15:50:49.493483 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_e11e234f713b40cd8772372c2316dd28", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/e11e234f713b40cd8772372c2316dd28"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/e11e234f713b40cd8772372c2316dd28"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/e11e234f713b40cd8772372c2316dd28"}]}] Jul 19 15:50:49.493483 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Tenant: tempest-AttachVolumeTestJSON-1928423787 Jul 19 15:50:49.493483 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Tenant-Id: e11e234f713b40cd8772372c2316dd28 Jul 19 15:50:49.493483 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1928423787 Jul 19 15:50:49.493483 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User: tempest-AttachVolumeTestJSON-1928423787-project Jul 19 15:50:49.493483 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Domain-Id: default Jul 19 15:50:49.493483 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Domain-Name: Default Jul 19 15:50:49.493483 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Id: d9c75043813844d79fd0764132dfe4dd Jul 19 15:50:49.493483 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Name: tempest-AttachVolumeTestJSON-1928423787-project Jul 19 15:50:49.493483 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: method: > Jul 19 15:50:49.493483 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: exception: Instance 343ae383-5bfd-4c70-8926-a800fcee3519 could not be found. Jul 19 15:50:49.493483 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: action_args: {'id': '343ae383-5bfd-4c70-8926-a800fcee3519'} Jul 19 15:50:49.494278 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:50:49.494278 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:50:49.494278 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 15:50:49.494278 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 15:50:49.494278 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 15:50:49.494278 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 15:50:49.494278 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 15:50:49.494278 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 15:50:49.494278 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 15:50:49.494278 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 15:50:49.494278 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 343ae383-5bfd-4c70-8926-a800fcee3519 could not be found. Jul 19 15:50:49.494278 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:50:49.494278 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:50:49.494278 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:50:49.494278 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:50:49.494278 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:50:49.494278 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:50:49.494278 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:50:49.494278 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:50:49.494278 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:50:49.495557 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:50:49.495557 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 15:50:49.495557 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 15:50:49.495557 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 15:50:49.495557 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 15:50:49.495557 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 15:50:49.495557 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 15:50:49.495557 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 343ae383-5bfd-4c70-8926-a800fcee3519 could not be found. Jul 19 15:50:49.495557 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:50:49.495557 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:50:49.495557 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:50:49.495557 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:50:49.495557 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:50:49.495557 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:50:49.495557 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:50:49.495557 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:50:49.495557 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 343ae383-5bfd-4c70-8926-a800fcee3519 could not be found. Jul 19 15:50:49.495557 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:50:49.496600 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-e1c023e2-65f1-4c6a-8674-d0165671a115 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Returning 404 to user: Instance 343ae383-5bfd-4c70-8926-a800fcee3519 could not be found. {{(pid=129519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:50:49.496600 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-e1c023e2-65f1-4c6a-8674-d0165671a115 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519" status: 404 len: 111 microversion: 2.1 time: 0.057126 Jul 19 15:50:49.500039 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-23040751-e934-4f57-a90a-23ec3ca4ccd9 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0" status: 200 len: 1725 microversion: 2.20 time: 0.214525 Jul 19 15:50:49.501353 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 397/737] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:50:49 2022] GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0 => generated 1725 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 15:50:49.506062 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-ba7b139e-743a-469b-acfc-1a640b551c8b tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Calling method '.version_select at 0x7fb8a5a62af0>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:50:49.507773 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 341/738] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:50:49 2022] GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519 => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 15:50:49.532476 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-ba7b139e-743a-469b-acfc-1a640b551c8b tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1462932047" status: 202 len: 0 microversion: 2.1 time: 0.029772 Jul 19 15:50:49.533131 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 398/739] 10.222.0.64 () {58 vars in 1220 bytes} [Tue Jul 19 15:50:49 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1462932047 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 15:50:50.220792 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-c0859ebf-f712-4ad1-b0db-90774b634e58 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Action: 'create', calling method: .version_select at 0x7fb8a5a51790>, body: {"keypair": {"name": "tempest-keypair-1724742079", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOoqedfIqK4CUK+7MQX5nFwiJrReVDTeX9d0p0gMC0gRDUB+gzVMW3TxT795Y695n/orm2u5OWpl5k9RXCGFJ3ZuuW4bv803SwQ2TIk8mA2h+CLZHsZJFazK88qJdhyWKQ=="}} {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:50:50.236112 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.quota [None req-c0859ebf-f712-4ad1-b0db-90774b634e58 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Getting quotas for project e11e234f713b40cd8772372c2316dd28. Resources: {'key_pairs'} {{(pid=129519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 15:50:50.240140 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.quota [None req-c0859ebf-f712-4ad1-b0db-90774b634e58 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Getting quotas for user d9c75043813844d79fd0764132dfe4dd and project e11e234f713b40cd8772372c2316dd28. Resources: {'key_pairs'} {{(pid=129519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 15:50:50.261449 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-c0859ebf-f712-4ad1-b0db-90774b634e58 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045055 Jul 19 15:50:50.262246 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 342/740] 10.222.0.64 () {60 vars in 1158 bytes} [Tue Jul 19 15:50:50 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:50:50.518273 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-dcbc20c7-82df-4103-b348-c411200a8f64 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:50:50.519026 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-dcbc20c7-82df-4103-b348-c411200a8f64 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: df3309b1-ba0f-4f40-937f-fc95c9c8f6a0] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:50:50.525774 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-dcbc20c7-82df-4103-b348-c411200a8f64 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:50.526222 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-dcbc20c7-82df-4103-b348-c411200a8f64 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:50.527085 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-dcbc20c7-82df-4103-b348-c411200a8f64 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:50.527469 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-dcbc20c7-82df-4103-b348-c411200a8f64 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:50.707539 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-dcbc20c7-82df-4103-b348-c411200a8f64 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:50:50.716154 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-dcbc20c7-82df-4103-b348-c411200a8f64 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:50:50.718057 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-dcbc20c7-82df-4103-b348-c411200a8f64 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:50:50.720649 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-dcbc20c7-82df-4103-b348-c411200a8f64 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0" status: 200 len: 1725 microversion: 2.20 time: 0.206280 Jul 19 15:50:50.721387 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 399/741] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:50:50 2022] GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0 => generated 1725 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:50:51.642832 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-f52cfee6-8f15-47dc-94ff-b67a3f018580 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-180025179", "imageRef": "15012099-fe38-45ac-bd33-d884a5ba65f2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7719a9e3-d30d-4797-868c-2dbb1911ec7c"}], "security_groups": [{"name": "tempest-securitygroup--939291688"}], "key_name": "tempest-keypair-1724742079", "user_data": "}} {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:50:51.739977 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-711d874f-f953-443f-830c-8a3d82d59391 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:50:51.740573 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-711d874f-f953-443f-830c-8a3d82d59391 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: df3309b1-ba0f-4f40-937f-fc95c9c8f6a0] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:50:51.747314 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-711d874f-f953-443f-830c-8a3d82d59391 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:51.747758 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-711d874f-f953-443f-830c-8a3d82d59391 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:51.748514 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-711d874f-f953-443f-830c-8a3d82d59391 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:51.748949 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-711d874f-f953-443f-830c-8a3d82d59391 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:51.752325 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.network.neutron [None req-f52cfee6-8f15-47dc-94ff-b67a3f018580 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] validate_networks() for [('7719a9e3-d30d-4797-868c-2dbb1911ec7c', None, None, None, None, None)] {{(pid=129519) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 15:50:51.753688 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG dbcounter [-] [129520] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:50:51.888786 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-711d874f-f953-443f-830c-8a3d82d59391 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:50:51.897021 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-711d874f-f953-443f-830c-8a3d82d59391 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:50:51.898719 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-711d874f-f953-443f-830c-8a3d82d59391 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:50:51.900005 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-711d874f-f953-443f-830c-8a3d82d59391 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0" status: 200 len: 1725 microversion: 2.20 time: 0.163967 Jul 19 15:50:51.900574 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 400/742] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:50:51 2022] GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0 => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 15:50:52.018024 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-e2739af1-c007-4a61-936a-0d4979ff3c3d tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:50:52.018548 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-e2739af1-c007-4a61-936a-0d4979ff3c3d tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 4fa1efb1-1488-48f4-a6ec-9b4787e01277] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:50:52.024849 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-e2739af1-c007-4a61-936a-0d4979ff3c3d tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:52.025303 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-e2739af1-c007-4a61-936a-0d4979ff3c3d tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:52.026071 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-e2739af1-c007-4a61-936a-0d4979ff3c3d tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:52.026544 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-e2739af1-c007-4a61-936a-0d4979ff3c3d tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:52.051793 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-e2739af1-c007-4a61-936a-0d4979ff3c3d tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 4fa1efb1-1488-48f4-a6ec-9b4787e01277] Going to try to terminate instance {{(pid=129520) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 15:50:52.131019 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-e2739af1-c007-4a61-936a-0d4979ff3c3d tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "DELETE /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277" status: 204 len: 0 microversion: 2.1 time: 0.117061 Jul 19 15:50:52.131802 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 401/743] 10.222.0.64 () {58 vars in 1238 bytes} [Tue Jul 19 15:50:52 2022] DELETE /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 19 15:50:52.141206 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-32ae9ee3-8d22-4511-8c61-10b23e9f40b4 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:50:52.141933 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-32ae9ee3-8d22-4511-8c61-10b23e9f40b4 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 4fa1efb1-1488-48f4-a6ec-9b4787e01277] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:50:52.148119 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-32ae9ee3-8d22-4511-8c61-10b23e9f40b4 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:52.148569 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-32ae9ee3-8d22-4511-8c61-10b23e9f40b4 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:52.149444 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-32ae9ee3-8d22-4511-8c61-10b23e9f40b4 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:52.149892 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-32ae9ee3-8d22-4511-8c61-10b23e9f40b4 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:52.183137 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.virt.hardware [None req-f52cfee6-8f15-47dc-94ff-b67a3f018580 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Flavor limits 0:0:0 {{(pid=129519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 15:50:52.183557 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.virt.hardware [None req-f52cfee6-8f15-47dc-94ff-b67a3f018580 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Image limits 0:0:0 {{(pid=129519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 15:50:52.184034 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.virt.hardware [None req-f52cfee6-8f15-47dc-94ff-b67a3f018580 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Flavor pref 0:0:0 {{(pid=129519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 15:50:52.184469 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.virt.hardware [None req-f52cfee6-8f15-47dc-94ff-b67a3f018580 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Image pref 0:0:0 {{(pid=129519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 15:50:52.184881 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.virt.hardware [None req-f52cfee6-8f15-47dc-94ff-b67a3f018580 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 15:50:52.194720 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-f52cfee6-8f15-47dc-94ff-b67a3f018580 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:52.195169 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-f52cfee6-8f15-47dc-94ff-b67a3f018580 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:52.195999 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-f52cfee6-8f15-47dc-94ff-b67a3f018580 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:52.196434 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-f52cfee6-8f15-47dc-94ff-b67a3f018580 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:52.213638 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.quota [None req-f52cfee6-8f15-47dc-94ff-b67a3f018580 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Getting quotas for project e11e234f713b40cd8772372c2316dd28. Resources: {'ram', 'instances', 'cores'} {{(pid=129519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 15:50:52.217667 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.quota [None req-f52cfee6-8f15-47dc-94ff-b67a3f018580 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Getting quotas for user d9c75043813844d79fd0764132dfe4dd and project e11e234f713b40cd8772372c2316dd28. Resources: {'ram', 'instances', 'cores'} {{(pid=129519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 15:50:52.229163 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-f52cfee6-8f15-47dc-94ff-b67a3f018580 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Going to run 1 instances... {{(pid=129519) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 15:50:52.231264 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-f52cfee6-8f15-47dc-94ff-b67a3f018580 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 95bf808e-8c6d-4702-b942-027288ec604a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='15012099-fe38-45ac-bd33-d884a5ba65f2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 15:50:52.281657 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-f52cfee6-8f15-47dc-94ff-b67a3f018580 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.643878 Jul 19 15:50:52.282301 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 343/744] 10.222.0.64 () {60 vars in 1146 bytes} [Tue Jul 19 15:50:51 2022] POST /compute/v2.1/servers => generated 401 bytes in 645 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 15:50:52.289893 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-32ae9ee3-8d22-4511-8c61-10b23e9f40b4 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:50:52.292253 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-684a097d-7fb9-44ad-9152-2b57128d3c3e tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:50:52.292859 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-684a097d-7fb9-44ad-9152-2b57128d3c3e tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 95bf808e-8c6d-4702-b942-027288ec604a] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:50:52.300797 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-32ae9ee3-8d22-4511-8c61-10b23e9f40b4 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277" status: 200 len: 1507 microversion: 2.1 time: 0.163995 Jul 19 15:50:52.302120 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 402/745] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:50:52 2022] GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277 => generated 1507 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:50:52.347120 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-684a097d-7fb9-44ad-9152-2b57128d3c3e tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c75043813844d79fd0764132dfe4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e234f713b40cd8772372c2316dd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:50:52.355194 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-684a097d-7fb9-44ad-9152-2b57128d3c3e tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "GET /compute/v2.1/servers/95bf808e-8c6d-4702-b942-027288ec604a" status: 200 len: 1237 microversion: 2.1 time: 0.066819 Jul 19 15:50:52.355753 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 344/746] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:50:52 2022] GET /compute/v2.1/servers/95bf808e-8c6d-4702-b942-027288ec604a => generated 1237 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:50:52.919735 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-7cc2db49-56c1-4a03-87e0-6c29d238d558 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:50:52.920275 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-7cc2db49-56c1-4a03-87e0-6c29d238d558 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: df3309b1-ba0f-4f40-937f-fc95c9c8f6a0] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:50:52.927450 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-7cc2db49-56c1-4a03-87e0-6c29d238d558 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:52.927893 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-7cc2db49-56c1-4a03-87e0-6c29d238d558 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:52.928645 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-7cc2db49-56c1-4a03-87e0-6c29d238d558 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:52.929074 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-7cc2db49-56c1-4a03-87e0-6c29d238d558 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:53.064383 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-7cc2db49-56c1-4a03-87e0-6c29d238d558 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:50:53.072588 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-7cc2db49-56c1-4a03-87e0-6c29d238d558 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:50:53.074072 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-7cc2db49-56c1-4a03-87e0-6c29d238d558 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:50:53.075244 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-7cc2db49-56c1-4a03-87e0-6c29d238d558 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0" status: 200 len: 1725 microversion: 2.20 time: 0.159555 Jul 19 15:50:53.075800 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 403/747] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:50:52 2022] GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:50:53.318234 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-f38e59c9-804d-41c1-b4d4-634c221dbb9e tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:50:53.318768 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-f38e59c9-804d-41c1-b4d4-634c221dbb9e tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 4fa1efb1-1488-48f4-a6ec-9b4787e01277] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:50:53.325294 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-f38e59c9-804d-41c1-b4d4-634c221dbb9e tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:53.325745 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-f38e59c9-804d-41c1-b4d4-634c221dbb9e tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:53.326538 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-f38e59c9-804d-41c1-b4d4-634c221dbb9e tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:53.326980 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-f38e59c9-804d-41c1-b4d4-634c221dbb9e tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:53.331102 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG dbcounter [-] [129519] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=129519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:50:53.372552 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-9b1312c6-d856-4664-84a1-75a0cdc44995 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:50:53.373163 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-9b1312c6-d856-4664-84a1-75a0cdc44995 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 95bf808e-8c6d-4702-b942-027288ec604a] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:50:53.379697 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-9b1312c6-d856-4664-84a1-75a0cdc44995 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:53.380348 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-9b1312c6-d856-4664-84a1-75a0cdc44995 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:53.381171 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-9b1312c6-d856-4664-84a1-75a0cdc44995 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:53.381641 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-9b1312c6-d856-4664-84a1-75a0cdc44995 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:53.452353 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-9b1312c6-d856-4664-84a1-75a0cdc44995 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c75043813844d79fd0764132dfe4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e234f713b40cd8772372c2316dd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:50:53.461205 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-9b1312c6-d856-4664-84a1-75a0cdc44995 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "GET /compute/v2.1/servers/95bf808e-8c6d-4702-b942-027288ec604a" status: 200 len: 1241 microversion: 2.1 time: 0.092532 Jul 19 15:50:53.461870 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 404/748] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:50:53 2022] GET /compute/v2.1/servers/95bf808e-8c6d-4702-b942-027288ec604a => generated 1241 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:50:53.462015 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-f38e59c9-804d-41c1-b4d4-634c221dbb9e tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:50:53.471467 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-f38e59c9-804d-41c1-b4d4-634c221dbb9e tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277" status: 200 len: 1507 microversion: 2.1 time: 0.157118 Jul 19 15:50:53.472037 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 345/749] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:50:53 2022] GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277 => generated 1507 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:50:54.094391 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-bed67c7d-c5f3-46a4-ab1b-f9c8a4506d87 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:50:54.095105 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-bed67c7d-c5f3-46a4-ab1b-f9c8a4506d87 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: df3309b1-ba0f-4f40-937f-fc95c9c8f6a0] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:50:54.101624 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-bed67c7d-c5f3-46a4-ab1b-f9c8a4506d87 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:54.102068 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-bed67c7d-c5f3-46a4-ab1b-f9c8a4506d87 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:54.102929 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-bed67c7d-c5f3-46a4-ab1b-f9c8a4506d87 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:54.103434 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-bed67c7d-c5f3-46a4-ab1b-f9c8a4506d87 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:54.241834 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-bed67c7d-c5f3-46a4-ab1b-f9c8a4506d87 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:50:54.250914 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-bed67c7d-c5f3-46a4-ab1b-f9c8a4506d87 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:50:54.252433 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-bed67c7d-c5f3-46a4-ab1b-f9c8a4506d87 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:50:54.253586 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-bed67c7d-c5f3-46a4-ab1b-f9c8a4506d87 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0" status: 200 len: 1725 microversion: 2.20 time: 0.163934 Jul 19 15:50:54.254143 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 405/750] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:50:54 2022] GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0 => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 15:50:54.478109 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-466e889e-efa1-43b9-8e9e-bad9761f124a tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:50:54.478672 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-466e889e-efa1-43b9-8e9e-bad9761f124a tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 95bf808e-8c6d-4702-b942-027288ec604a] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:50:54.495030 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-fb2e30de-0083-41e5-92ac-5f0ff387d31d tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:50:54.497338 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-fb2e30de-0083-41e5-92ac-5f0ff387d31d tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 4fa1efb1-1488-48f4-a6ec-9b4787e01277] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:50:54.497457 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-466e889e-efa1-43b9-8e9e-bad9761f124a tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:54.497457 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-466e889e-efa1-43b9-8e9e-bad9761f124a tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:54.497457 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-466e889e-efa1-43b9-8e9e-bad9761f124a tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:54.497727 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-466e889e-efa1-43b9-8e9e-bad9761f124a tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:54.506445 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-fb2e30de-0083-41e5-92ac-5f0ff387d31d tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:54.508253 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-fb2e30de-0083-41e5-92ac-5f0ff387d31d tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:54.508253 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-fb2e30de-0083-41e5-92ac-5f0ff387d31d tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:54.508253 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-fb2e30de-0083-41e5-92ac-5f0ff387d31d tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:54.613097 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-466e889e-efa1-43b9-8e9e-bad9761f124a tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c75043813844d79fd0764132dfe4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e234f713b40cd8772372c2316dd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:50:54.622808 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-466e889e-efa1-43b9-8e9e-bad9761f124a tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "GET /compute/v2.1/servers/95bf808e-8c6d-4702-b942-027288ec604a" status: 200 len: 1289 microversion: 2.1 time: 0.148479 Jul 19 15:50:54.623692 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 346/751] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:50:54 2022] GET /compute/v2.1/servers/95bf808e-8c6d-4702-b942-027288ec604a => generated 1289 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:50:54.673905 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-fb2e30de-0083-41e5-92ac-5f0ff387d31d tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:50:54.681922 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-fb2e30de-0083-41e5-92ac-5f0ff387d31d tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277" status: 200 len: 1507 microversion: 2.1 time: 0.197856 Jul 19 15:50:54.682726 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 406/752] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:50:54 2022] GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277 => generated 1507 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:50:54.986339 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [req-4331f9d7-03f9-40c2-a3d0-57bcfbb2638e req-15431292-9e7c-478b-b884-60f0286093d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4fa1efb1-1488-48f4-a6ec-9b4787e01277", "name": "network-vif-deleted", "tag": "5e64b358-ca05-4217-81f6-26f217876ab3"}]} {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:50:54.996320 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [req-4331f9d7-03f9-40c2-a3d0-57bcfbb2638e req-15431292-9e7c-478b-b884-60f0286093d9 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:54.996740 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [req-4331f9d7-03f9-40c2-a3d0-57bcfbb2638e req-15431292-9e7c-478b-b884-60f0286093d9 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:55.009874 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.compute.server_external_events [req-4331f9d7-03f9-40c2-a3d0-57bcfbb2638e req-15431292-9e7c-478b-b884-60f0286093d9 service nova] Creating event network-vif-deleted:5e64b358-ca05-4217-81f6-26f217876ab3 for instance 4fa1efb1-1488-48f4-a6ec-9b4787e01277 on hv-cinder-84902 Jul 19 15:50:55.015365 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [req-4331f9d7-03f9-40c2-a3d0-57bcfbb2638e req-15431292-9e7c-478b-b884-60f0286093d9 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034149 Jul 19 15:50:55.020936 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 347/753] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Jul 19 15:50:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:50:55.272118 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-496f4a28-a006-47ec-a16c-beb6ad121808 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:50:55.272910 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-496f4a28-a006-47ec-a16c-beb6ad121808 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: df3309b1-ba0f-4f40-937f-fc95c9c8f6a0] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:50:55.279606 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-496f4a28-a006-47ec-a16c-beb6ad121808 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:55.280045 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-496f4a28-a006-47ec-a16c-beb6ad121808 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:55.280855 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-496f4a28-a006-47ec-a16c-beb6ad121808 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:55.281291 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-496f4a28-a006-47ec-a16c-beb6ad121808 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:55.515693 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-496f4a28-a006-47ec-a16c-beb6ad121808 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:50:55.524121 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-496f4a28-a006-47ec-a16c-beb6ad121808 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:50:55.525623 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-496f4a28-a006-47ec-a16c-beb6ad121808 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:50:55.526803 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-496f4a28-a006-47ec-a16c-beb6ad121808 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0" status: 200 len: 1725 microversion: 2.20 time: 0.258942 Jul 19 15:50:55.527671 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 407/754] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:50:55 2022] GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0 => generated 1725 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:50:55.647574 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-265f6285-02d6-4e50-b87c-e62f475c4c88 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:50:55.648288 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-265f6285-02d6-4e50-b87c-e62f475c4c88 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 95bf808e-8c6d-4702-b942-027288ec604a] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:50:55.656083 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-265f6285-02d6-4e50-b87c-e62f475c4c88 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:55.656827 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-265f6285-02d6-4e50-b87c-e62f475c4c88 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:55.658187 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-265f6285-02d6-4e50-b87c-e62f475c4c88 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:55.658727 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-265f6285-02d6-4e50-b87c-e62f475c4c88 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:55.704706 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-b3ecbc63-f5de-414f-bc8d-a9679f9e2156 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:50:55.707932 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-b3ecbc63-f5de-414f-bc8d-a9679f9e2156 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 4fa1efb1-1488-48f4-a6ec-9b4787e01277] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:50:55.721367 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b3ecbc63-f5de-414f-bc8d-a9679f9e2156 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:55.721817 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b3ecbc63-f5de-414f-bc8d-a9679f9e2156 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:55.722622 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b3ecbc63-f5de-414f-bc8d-a9679f9e2156 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:55.723056 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b3ecbc63-f5de-414f-bc8d-a9679f9e2156 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:55.741353 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.wsgi [None req-b3ecbc63-f5de-414f-bc8d-a9679f9e2156 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] HTTP exception thrown: Instance 4fa1efb1-1488-48f4-a6ec-9b4787e01277 could not be found. Jul 19 15:50:55.743036 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-b3ecbc63-f5de-414f-bc8d-a9679f9e2156 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Request method failure captured: Jul 19 15:50:55.743036 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: request: GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277 HTTP/1.1 Jul 19 15:50:55.743036 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Accept: application/json Jul 19 15:50:55.743036 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Accept-Encoding: identity Jul 19 15:50:55.743036 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Connection: close Jul 19 15:50:55.743036 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Content-Length: 0 Jul 19 15:50:55.743036 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Content-Type: application/json Jul 19 15:50:55.743036 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Host: 10.222.0.64 Jul 19 15:50:55.743036 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Openstack-System-Scope: None Jul 19 15:50:55.743036 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: User-Agent: python-urllib3/1.26.9 Jul 19 15:50:55.743036 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Auth-Token: gAAAAABi1tGPG3TL2GwfAc0kf5LaV9cX4pbJFxTWqQKwJFE5MwZWkdPruymWghvL56VHYnPjmTX00Dxb6n-I5a-K8qDlTUL3Rdjijr9hGViaVz0EvfiTyEi0NIlocc44JNIONZOhLldSNTzzdFWiWGRLTkuRKHFmrDA7ImfJvTM2riB9cOts4j4 Jul 19 15:50:55.743036 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Domain-Id: None Jul 19 15:50:55.743036 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Domain-Name: None Jul 19 15:50:55.743036 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Identity-Status: Confirmed Jul 19 15:50:55.743036 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Is-Admin-Project: True Jul 19 15:50:55.743036 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Project-Domain-Id: default Jul 19 15:50:55.743036 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Project-Domain-Name: Default Jul 19 15:50:55.743036 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Project-Id: a872b4eafae74b82896bd09229152104 Jul 19 15:50:55.743036 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1658676 Jul 19 15:50:55.743036 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Role: member,reader Jul 19 15:50:55.743036 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Roles: member,reader Jul 19 15:50:55.744591 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_a872b4eafae74b82896bd09229152104", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a872b4eafae74b82896bd09229152104"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a872b4eafae74b82896bd09229152104"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/a872b4eafae74b82896bd09229152104"}]}] Jul 19 15:50:55.744591 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1658676 Jul 19 15:50:55.744591 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Tenant-Id: a872b4eafae74b82896bd09229152104 Jul 19 15:50:55.744591 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1658676 Jul 19 15:50:55.744591 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User: tempest-ServerRescueNegativeTestJSON-1658676-project Jul 19 15:50:55.744591 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User-Domain-Id: default Jul 19 15:50:55.744591 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User-Domain-Name: Default Jul 19 15:50:55.744591 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User-Id: 4785719411fd4af892868d99fca7cd71 Jul 19 15:50:55.744591 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1658676-project Jul 19 15:50:55.744591 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: method: > Jul 19 15:50:55.744591 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: exception: Instance 4fa1efb1-1488-48f4-a6ec-9b4787e01277 could not be found. Jul 19 15:50:55.744591 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: action_args: {'id': '4fa1efb1-1488-48f4-a6ec-9b4787e01277'} Jul 19 15:50:55.745461 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:50:55.745461 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:50:55.745461 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 15:50:55.745461 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 15:50:55.745461 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 15:50:55.745461 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 15:50:55.745461 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 15:50:55.745461 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 15:50:55.745461 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 15:50:55.745461 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 15:50:55.745461 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4fa1efb1-1488-48f4-a6ec-9b4787e01277 could not be found. Jul 19 15:50:55.745461 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:50:55.745461 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:50:55.745461 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:50:55.745461 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:50:55.745461 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:50:55.745461 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:50:55.745461 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:50:55.745461 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:50:55.745461 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:50:55.746766 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:50:55.746766 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 15:50:55.746766 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 15:50:55.746766 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 15:50:55.746766 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 15:50:55.746766 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 15:50:55.746766 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 15:50:55.746766 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4fa1efb1-1488-48f4-a6ec-9b4787e01277 could not be found. Jul 19 15:50:55.746766 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:50:55.746766 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:50:55.746766 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:50:55.746766 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:50:55.746766 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:50:55.746766 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:50:55.746766 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:50:55.746766 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:50:55.746766 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4fa1efb1-1488-48f4-a6ec-9b4787e01277 could not be found. Jul 19 15:50:55.746766 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:50:55.748804 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-b3ecbc63-f5de-414f-bc8d-a9679f9e2156 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Returning 404 to user: Instance 4fa1efb1-1488-48f4-a6ec-9b4787e01277 could not be found. {{(pid=129520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:50:55.749844 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-b3ecbc63-f5de-414f-bc8d-a9679f9e2156 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277" status: 404 len: 111 microversion: 2.1 time: 0.055104 Jul 19 15:50:55.750610 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 408/755] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:50:55 2022] GET /compute/v2.1/servers/4fa1efb1-1488-48f4-a6ec-9b4787e01277 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 15:50:55.758996 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-3c4d8c12-e78d-4c0b-a9da-0fbc8066cf2d tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8598c3ff-d749-423a-94bc-227b82f6b4c2"}} {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:50:55.760342 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-3c4d8c12-e78d-4c0b-a9da-0fbc8066cf2d tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: d1382aa7-6d93-410a-94ae-a7944114573f] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:50:55.771829 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-3c4d8c12-e78d-4c0b-a9da-0fbc8066cf2d tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:55.772585 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-3c4d8c12-e78d-4c0b-a9da-0fbc8066cf2d tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:55.773546 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-3c4d8c12-e78d-4c0b-a9da-0fbc8066cf2d tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:55.774142 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-3c4d8c12-e78d-4c0b-a9da-0fbc8066cf2d tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:55.860042 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-265f6285-02d6-4e50-b87c-e62f475c4c88 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c75043813844d79fd0764132dfe4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e234f713b40cd8772372c2316dd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:50:55.869398 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-265f6285-02d6-4e50-b87c-e62f475c4c88 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "GET /compute/v2.1/servers/95bf808e-8c6d-4702-b942-027288ec604a" status: 200 len: 1362 microversion: 2.1 time: 0.231719 Jul 19 15:50:55.870177 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 348/756] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:50:55 2022] GET /compute/v2.1/servers/95bf808e-8c6d-4702-b942-027288ec604a => generated 1362 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:50:55.875636 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-4b018edb-c140-4042-b005-890e3aa64d3c tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:50:55.876127 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-4b018edb-c140-4042-b005-890e3aa64d3c tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 764ab5a7-4ebb-4d76-a34b-5f311883bcbe] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:50:55.882825 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-4b018edb-c140-4042-b005-890e3aa64d3c tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:55.883542 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-4b018edb-c140-4042-b005-890e3aa64d3c tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:55.884501 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-4b018edb-c140-4042-b005-890e3aa64d3c tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:55.885109 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-4b018edb-c140-4042-b005-890e3aa64d3c tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:55.890831 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.wsgi [None req-3c4d8c12-e78d-4c0b-a9da-0fbc8066cf2d tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] HTTP exception thrown: Invalid volume: volume 8598c3ff-d749-423a-94bc-227b82f6b4c2 is already attached to instances: d1382aa7-6d93-410a-94ae-a7944114573f Jul 19 15:50:55.892783 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-3c4d8c12-e78d-4c0b-a9da-0fbc8066cf2d tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Request method failure captured: Jul 19 15:50:55.892783 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: request: POST /compute/v2.1/servers/d1382aa7-6d93-410a-94ae-a7944114573f/os-volume_attachments HTTP/1.1 Jul 19 15:50:55.892783 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Accept: application/json Jul 19 15:50:55.892783 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Accept-Encoding: identity Jul 19 15:50:55.892783 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Connection: close Jul 19 15:50:55.892783 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Content-Length: 74 Jul 19 15:50:55.892783 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Content-Type: application/json Jul 19 15:50:55.892783 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Host: 10.222.0.64 Jul 19 15:50:55.892783 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Openstack-System-Scope: None Jul 19 15:50:55.892783 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: User-Agent: python-urllib3/1.26.9 Jul 19 15:50:55.892783 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Auth-Token: gAAAAABi1tGPtVnrBLo0yCDS-Fxp117KmoW30EOrAzeE-HWJZTaOLzmdVU7ilJLT24AK1cNZoT6hZsY9VJG83Xk6FPFrebHG3s54Fuj7pMRO-j7b_NklvH50XPBLW-GpDpGZ3ebrTqCiTKXUJEZA0zlfYPmMdreiVMLme-IYyDlHVZle_DtpLr0 Jul 19 15:50:55.892783 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Domain-Id: None Jul 19 15:50:55.892783 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Domain-Name: None Jul 19 15:50:55.892783 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Identity-Status: Confirmed Jul 19 15:50:55.892783 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Is-Admin-Project: True Jul 19 15:50:55.892783 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Project-Domain-Id: default Jul 19 15:50:55.892783 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Project-Domain-Name: Default Jul 19 15:50:55.892783 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Project-Id: 45a72d232f314a78b0e1c3f04b0ed682 Jul 19 15:50:55.892783 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Project-Name: tempest-AttachVolumeNegativeTest-1922780758 Jul 19 15:50:55.892783 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Role: member,reader Jul 19 15:50:55.892783 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Roles: member,reader Jul 19 15:50:55.894154 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_45a72d232f314a78b0e1c3f04b0ed682", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/45a72d232f314a78b0e1c3f04b0ed682"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/45a72d232f314a78b0e1c3f04b0ed682"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/45a72d232f314a78b0e1c3f04b0ed682"}]}] Jul 19 15:50:55.894154 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Tenant: tempest-AttachVolumeNegativeTest-1922780758 Jul 19 15:50:55.894154 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Tenant-Id: 45a72d232f314a78b0e1c3f04b0ed682 Jul 19 15:50:55.894154 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1922780758 Jul 19 15:50:55.894154 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User: tempest-AttachVolumeNegativeTest-1922780758-project Jul 19 15:50:55.894154 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User-Domain-Id: default Jul 19 15:50:55.894154 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User-Domain-Name: Default Jul 19 15:50:55.894154 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User-Id: 2d7c42cf0bc84292bb0b7edb9f2e7fc3 Jul 19 15:50:55.894154 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User-Name: tempest-AttachVolumeNegativeTest-1922780758-project Jul 19 15:50:55.894154 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Jul 19 15:50:55.894154 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: {"volumeAttachment": {"volumeId": "8598c3ff-d749-423a-94bc-227b82f6b4c2"}} Jul 19 15:50:55.894154 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: method: > Jul 19 15:50:55.894933 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: exception: Invalid volume: volume 8598c3ff-d749-423a-94bc-227b82f6b4c2 is already attached to instances: d1382aa7-6d93-410a-94ae-a7944114573f Jul 19 15:50:55.894933 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: action_args: {'server_id': 'd1382aa7-6d93-410a-94ae-a7944114573f', 'body': {'volumeAttachment': {'volumeId': '8598c3ff-d749-423a-94bc-227b82f6b4c2'}}} Jul 19 15:50:55.894933 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:50:55.894933 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:50:55.894933 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 19 15:50:55.894933 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 19 15:50:55.894933 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 19 15:50:55.894933 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 19 15:50:55.894933 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 19 15:50:55.894933 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 19 15:50:55.894933 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 19 15:50:55.894933 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 19 15:50:55.894933 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 19 15:50:55.894933 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 19 15:50:55.894933 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 8598c3ff-d749-423a-94bc-227b82f6b4c2 is already attached to instances: d1382aa7-6d93-410a-94ae-a7944114573f Jul 19 15:50:55.894933 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:50:55.894933 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:50:55.894933 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:50:55.894933 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:50:55.896065 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:50:55.896065 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:50:55.896065 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:50:55.896065 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:50:55.896065 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:50:55.896065 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:50:55.896065 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 15:50:55.896065 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 15:50:55.896065 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 15:50:55.896065 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 15:50:55.896065 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 19 15:50:55.896065 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 19 15:50:55.896065 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 19 15:50:55.896065 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 19 15:50:55.896065 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 8598c3ff-d749-423a-94bc-227b82f6b4c2 is already attached to instances: d1382aa7-6d93-410a-94ae-a7944114573f Jul 19 15:50:55.896065 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:50:55.896065 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:50:55.896065 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:50:55.896065 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:50:55.896065 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:50:55.898483 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:50:55.898483 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:50:55.898483 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:50:55.898483 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 8598c3ff-d749-423a-94bc-227b82f6b4c2 is already attached to instances: d1382aa7-6d93-410a-94ae-a7944114573f Jul 19 15:50:55.898483 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:50:55.898483 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-3c4d8c12-e78d-4c0b-a9da-0fbc8066cf2d tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Returning 400 to user: Invalid volume: volume 8598c3ff-d749-423a-94bc-227b82f6b4c2 is already attached to instances: d1382aa7-6d93-410a-94ae-a7944114573f {{(pid=129520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:50:55.898483 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-3c4d8c12-e78d-4c0b-a9da-0fbc8066cf2d tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "POST /compute/v2.1/servers/d1382aa7-6d93-410a-94ae-a7944114573f/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.139647 Jul 19 15:50:55.902881 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 409/757] 10.222.0.64 () {60 vars in 1322 bytes} [Tue Jul 19 15:50:55 2022] POST /compute/v2.1/servers/d1382aa7-6d93-410a-94ae-a7944114573f/os-volume_attachments => generated 174 bytes in 145 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 19 15:50:55.922199 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-4b018edb-c140-4042-b005-890e3aa64d3c tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 764ab5a7-4ebb-4d76-a34b-5f311883bcbe] Going to try to terminate instance {{(pid=129519) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 15:50:55.974612 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-b2f1c645-8ccd-45ff-8616-f84b5961e6c6 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:50:55.975201 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-b2f1c645-8ccd-45ff-8616-f84b5961e6c6 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: d1382aa7-6d93-410a-94ae-a7944114573f] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:50:55.981812 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b2f1c645-8ccd-45ff-8616-f84b5961e6c6 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:55.982574 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b2f1c645-8ccd-45ff-8616-f84b5961e6c6 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:55.983562 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b2f1c645-8ccd-45ff-8616-f84b5961e6c6 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:55.984836 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b2f1c645-8ccd-45ff-8616-f84b5961e6c6 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:56.018486 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-4b018edb-c140-4042-b005-890e3aa64d3c tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "DELETE /compute/v2.1/servers/764ab5a7-4ebb-4d76-a34b-5f311883bcbe" status: 204 len: 0 microversion: 2.1 time: 0.146443 Jul 19 15:50:56.019172 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 349/758] 10.222.0.64 () {58 vars in 1238 bytes} [Tue Jul 19 15:50:55 2022] DELETE /compute/v2.1/servers/764ab5a7-4ebb-4d76-a34b-5f311883bcbe => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 15:50:56.028167 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-c2cc1edf-9e59-4f43-95c1-6121d1210ac5 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:50:56.028860 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-c2cc1edf-9e59-4f43-95c1-6121d1210ac5 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 764ab5a7-4ebb-4d76-a34b-5f311883bcbe] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:50:56.036019 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-c2cc1edf-9e59-4f43-95c1-6121d1210ac5 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:56.036339 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-c2cc1edf-9e59-4f43-95c1-6121d1210ac5 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:56.037303 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-c2cc1edf-9e59-4f43-95c1-6121d1210ac5 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:56.037743 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-c2cc1edf-9e59-4f43-95c1-6121d1210ac5 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:56.100618 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.objects.instance [None req-b2f1c645-8ccd-45ff-8616-f84b5961e6c6 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lazy-loading 'services' on Instance uuid d1382aa7-6d93-410a-94ae-a7944114573f {{(pid=129520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 15:50:56.179462 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-b2f1c645-8ccd-45ff-8616-f84b5961e6c6 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "DELETE /compute/v2.1/servers/d1382aa7-6d93-410a-94ae-a7944114573f/os-volume_attachments/8598c3ff-d749-423a-94bc-227b82f6b4c2" status: 202 len: 0 microversion: 2.1 time: 0.209040 Jul 19 15:50:56.180153 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 410/759] 10.222.0.64 () {58 vars in 1415 bytes} [Tue Jul 19 15:50:55 2022] DELETE /compute/v2.1/servers/d1382aa7-6d93-410a-94ae-a7944114573f/os-volume_attachments/8598c3ff-d749-423a-94bc-227b82f6b4c2 => generated 0 bytes in 212 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 19 15:50:56.192615 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-36553ee8-f0a5-4163-810c-fec5f4852039 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:50:56.194048 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-36553ee8-f0a5-4163-810c-fec5f4852039 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: d1382aa7-6d93-410a-94ae-a7944114573f] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:50:56.197810 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-c2cc1edf-9e59-4f43-95c1-6121d1210ac5 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:50:56.201137 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-36553ee8-f0a5-4163-810c-fec5f4852039 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:56.201761 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-36553ee8-f0a5-4163-810c-fec5f4852039 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:56.202837 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-36553ee8-f0a5-4163-810c-fec5f4852039 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:56.203248 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-36553ee8-f0a5-4163-810c-fec5f4852039 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:56.205849 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-c2cc1edf-9e59-4f43-95c1-6121d1210ac5 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/764ab5a7-4ebb-4d76-a34b-5f311883bcbe" status: 200 len: 1521 microversion: 2.1 time: 0.182166 Jul 19 15:50:56.207049 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 350/760] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:50:56 2022] GET /compute/v2.1/servers/764ab5a7-4ebb-4d76-a34b-5f311883bcbe => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:50:56.234276 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-36553ee8-f0a5-4163-810c-fec5f4852039 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/d1382aa7-6d93-410a-94ae-a7944114573f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048987 Jul 19 15:50:56.234868 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 411/761] 10.222.0.64 () {58 vars in 1301 bytes} [Tue Jul 19 15:50:56 2022] GET /compute/v2.1/servers/d1382aa7-6d93-410a-94ae-a7944114573f/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 15:50:56.546565 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-1642b088-9ac0-4b3f-9800-f055fdd321d7 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:50:56.547193 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-1642b088-9ac0-4b3f-9800-f055fdd321d7 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: df3309b1-ba0f-4f40-937f-fc95c9c8f6a0] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:50:56.553807 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-1642b088-9ac0-4b3f-9800-f055fdd321d7 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:56.554251 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-1642b088-9ac0-4b3f-9800-f055fdd321d7 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:56.555048 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-1642b088-9ac0-4b3f-9800-f055fdd321d7 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:56.555476 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-1642b088-9ac0-4b3f-9800-f055fdd321d7 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:56.700683 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-1642b088-9ac0-4b3f-9800-f055fdd321d7 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:50:56.709883 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-1642b088-9ac0-4b3f-9800-f055fdd321d7 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:50:56.711754 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-1642b088-9ac0-4b3f-9800-f055fdd321d7 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:50:56.712917 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-1642b088-9ac0-4b3f-9800-f055fdd321d7 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0" status: 200 len: 1725 microversion: 2.20 time: 0.170484 Jul 19 15:50:56.723765 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 351/762] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:50:56 2022] GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0 => generated 1725 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:50:56.744675 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [req-1398c512-c174-4d07-b9e3-abe9b3f724ad req-f791f399-b6fd-49c8-8e18-55c818bdde6a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95bf808e-8c6d-4702-b942-027288ec604a", "tag": "ebbcf9c9-0a61-4248-af0f-40d0e408b9f3"}]} {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:50:56.753362 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [req-1398c512-c174-4d07-b9e3-abe9b3f724ad req-f791f399-b6fd-49c8-8e18-55c818bdde6a service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:56.753799 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [req-1398c512-c174-4d07-b9e3-abe9b3f724ad req-f791f399-b6fd-49c8-8e18-55c818bdde6a service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:56.766534 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.compute.server_external_events [req-1398c512-c174-4d07-b9e3-abe9b3f724ad req-f791f399-b6fd-49c8-8e18-55c818bdde6a service nova] Creating event network-changed:ebbcf9c9-0a61-4248-af0f-40d0e408b9f3 for instance 95bf808e-8c6d-4702-b942-027288ec604a on hv-cinder-84902 Jul 19 15:50:56.771637 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [req-1398c512-c174-4d07-b9e3-abe9b3f724ad req-f791f399-b6fd-49c8-8e18-55c818bdde6a service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030593 Jul 19 15:50:56.772240 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 412/763] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Jul 19 15:50:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:50:56.886852 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-e4df6afa-8204-4025-9876-29f98ab836ae tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:50:56.887453 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-e4df6afa-8204-4025-9876-29f98ab836ae tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 95bf808e-8c6d-4702-b942-027288ec604a] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:50:56.894377 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-e4df6afa-8204-4025-9876-29f98ab836ae tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:56.894836 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-e4df6afa-8204-4025-9876-29f98ab836ae tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:56.895606 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-e4df6afa-8204-4025-9876-29f98ab836ae tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:56.896034 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-e4df6afa-8204-4025-9876-29f98ab836ae tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:57.030316 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-e4df6afa-8204-4025-9876-29f98ab836ae tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c75043813844d79fd0764132dfe4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e234f713b40cd8772372c2316dd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:50:57.038242 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-e4df6afa-8204-4025-9876-29f98ab836ae tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "GET /compute/v2.1/servers/95bf808e-8c6d-4702-b942-027288ec604a" status: 200 len: 1362 microversion: 2.1 time: 0.155260 Jul 19 15:50:57.038835 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 352/764] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:50:56 2022] GET /compute/v2.1/servers/95bf808e-8c6d-4702-b942-027288ec604a => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:50:57.224769 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-a280117f-6298-482a-8ee4-f03987d04fbf tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:50:57.225423 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-a280117f-6298-482a-8ee4-f03987d04fbf tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 764ab5a7-4ebb-4d76-a34b-5f311883bcbe] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:50:57.231777 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-a280117f-6298-482a-8ee4-f03987d04fbf tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:57.232223 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-a280117f-6298-482a-8ee4-f03987d04fbf tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:57.232974 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-a280117f-6298-482a-8ee4-f03987d04fbf tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:57.233405 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-a280117f-6298-482a-8ee4-f03987d04fbf tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:57.244938 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-85f94d58-ac99-4bf2-8b3b-fbda73e7b7fb tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:50:57.245955 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-85f94d58-ac99-4bf2-8b3b-fbda73e7b7fb tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: d1382aa7-6d93-410a-94ae-a7944114573f] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:50:57.252147 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-85f94d58-ac99-4bf2-8b3b-fbda73e7b7fb tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:57.252597 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-85f94d58-ac99-4bf2-8b3b-fbda73e7b7fb tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:57.253369 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-85f94d58-ac99-4bf2-8b3b-fbda73e7b7fb tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:57.253806 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-85f94d58-ac99-4bf2-8b3b-fbda73e7b7fb tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:57.283799 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-85f94d58-ac99-4bf2-8b3b-fbda73e7b7fb tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/d1382aa7-6d93-410a-94ae-a7944114573f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042663 Jul 19 15:50:57.284606 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 353/765] 10.222.0.64 () {58 vars in 1301 bytes} [Tue Jul 19 15:50:57 2022] GET /compute/v2.1/servers/d1382aa7-6d93-410a-94ae-a7944114573f/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 15:50:57.367026 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-a280117f-6298-482a-8ee4-f03987d04fbf tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:50:57.374856 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-a280117f-6298-482a-8ee4-f03987d04fbf tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/764ab5a7-4ebb-4d76-a34b-5f311883bcbe" status: 200 len: 1521 microversion: 2.1 time: 0.154067 Jul 19 15:50:57.375419 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 413/766] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:50:57 2022] GET /compute/v2.1/servers/764ab5a7-4ebb-4d76-a34b-5f311883bcbe => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:50:57.730691 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-4ed8f3d1-1c04-40ac-bb39-61281a8f5815 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:50:57.731298 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-4ed8f3d1-1c04-40ac-bb39-61281a8f5815 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: df3309b1-ba0f-4f40-937f-fc95c9c8f6a0] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:50:57.738451 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-4ed8f3d1-1c04-40ac-bb39-61281a8f5815 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:57.738910 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-4ed8f3d1-1c04-40ac-bb39-61281a8f5815 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:57.739669 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-4ed8f3d1-1c04-40ac-bb39-61281a8f5815 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:57.740104 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-4ed8f3d1-1c04-40ac-bb39-61281a8f5815 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:57.868167 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-4ed8f3d1-1c04-40ac-bb39-61281a8f5815 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:50:57.875986 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-4ed8f3d1-1c04-40ac-bb39-61281a8f5815 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:50:57.877470 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-4ed8f3d1-1c04-40ac-bb39-61281a8f5815 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:50:57.878630 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-4ed8f3d1-1c04-40ac-bb39-61281a8f5815 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0" status: 200 len: 1725 microversion: 2.20 time: 0.151937 Jul 19 15:50:57.879187 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 354/767] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:50:57 2022] GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:50:58.056568 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-d3205313-796e-49d5-862b-09ebe2e45225 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:50:58.057170 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-d3205313-796e-49d5-862b-09ebe2e45225 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 95bf808e-8c6d-4702-b942-027288ec604a] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:50:58.063767 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-d3205313-796e-49d5-862b-09ebe2e45225 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:58.064209 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-d3205313-796e-49d5-862b-09ebe2e45225 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:58.064964 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-d3205313-796e-49d5-862b-09ebe2e45225 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:58.065404 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-d3205313-796e-49d5-862b-09ebe2e45225 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:58.229184 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-d3205313-796e-49d5-862b-09ebe2e45225 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c75043813844d79fd0764132dfe4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e234f713b40cd8772372c2316dd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:50:58.236746 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-d3205313-796e-49d5-862b-09ebe2e45225 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "GET /compute/v2.1/servers/95bf808e-8c6d-4702-b942-027288ec604a" status: 200 len: 1362 microversion: 2.1 time: 0.184213 Jul 19 15:50:58.237303 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 414/768] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:50:58 2022] GET /compute/v2.1/servers/95bf808e-8c6d-4702-b942-027288ec604a => generated 1362 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:50:58.295271 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-e5390684-10c9-4d82-8e3f-4e6105bbf870 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:50:58.296303 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-e5390684-10c9-4d82-8e3f-4e6105bbf870 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: d1382aa7-6d93-410a-94ae-a7944114573f] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:50:58.303894 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-e5390684-10c9-4d82-8e3f-4e6105bbf870 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:58.304344 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-e5390684-10c9-4d82-8e3f-4e6105bbf870 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:58.305851 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-e5390684-10c9-4d82-8e3f-4e6105bbf870 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:58.306300 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-e5390684-10c9-4d82-8e3f-4e6105bbf870 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:58.344333 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-e5390684-10c9-4d82-8e3f-4e6105bbf870 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/d1382aa7-6d93-410a-94ae-a7944114573f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053159 Jul 19 15:50:58.344886 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 355/769] 10.222.0.64 () {58 vars in 1301 bytes} [Tue Jul 19 15:50:58 2022] GET /compute/v2.1/servers/d1382aa7-6d93-410a-94ae-a7944114573f/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:50:58.393426 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-2bdbd429-4b5e-4e8f-8dac-82701eadedf9 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:50:58.393956 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-2bdbd429-4b5e-4e8f-8dac-82701eadedf9 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 764ab5a7-4ebb-4d76-a34b-5f311883bcbe] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:50:58.400051 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-2bdbd429-4b5e-4e8f-8dac-82701eadedf9 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:58.400502 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-2bdbd429-4b5e-4e8f-8dac-82701eadedf9 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:58.401263 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-2bdbd429-4b5e-4e8f-8dac-82701eadedf9 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:58.401696 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-2bdbd429-4b5e-4e8f-8dac-82701eadedf9 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:58.561571 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-2bdbd429-4b5e-4e8f-8dac-82701eadedf9 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:50:58.566564 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG dbcounter [-] [129520] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=129520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:50:58.571213 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-2bdbd429-4b5e-4e8f-8dac-82701eadedf9 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/764ab5a7-4ebb-4d76-a34b-5f311883bcbe" status: 200 len: 1521 microversion: 2.1 time: 0.182505 Jul 19 15:50:58.571798 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 415/770] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:50:58 2022] GET /compute/v2.1/servers/764ab5a7-4ebb-4d76-a34b-5f311883bcbe => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:50:58.900320 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-0ad836c3-4be0-4263-ba3b-17bcd0ef4a93 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:50:58.901574 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-0ad836c3-4be0-4263-ba3b-17bcd0ef4a93 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: df3309b1-ba0f-4f40-937f-fc95c9c8f6a0] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:50:58.909862 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-0ad836c3-4be0-4263-ba3b-17bcd0ef4a93 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:58.910594 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-0ad836c3-4be0-4263-ba3b-17bcd0ef4a93 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:58.911551 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-0ad836c3-4be0-4263-ba3b-17bcd0ef4a93 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:58.912133 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-0ad836c3-4be0-4263-ba3b-17bcd0ef4a93 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:59.128318 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-0ad836c3-4be0-4263-ba3b-17bcd0ef4a93 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:50:59.137500 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-0ad836c3-4be0-4263-ba3b-17bcd0ef4a93 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:50:59.139054 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-0ad836c3-4be0-4263-ba3b-17bcd0ef4a93 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:50:59.141323 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-0ad836c3-4be0-4263-ba3b-17bcd0ef4a93 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0" status: 200 len: 1725 microversion: 2.20 time: 0.247135 Jul 19 15:50:59.146495 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 356/771] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:50:58 2022] GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0 => generated 1725 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 15:50:59.253324 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-5426d0f3-2d06-45b6-a42c-4fd88afba6bc tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:50:59.254174 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-5426d0f3-2d06-45b6-a42c-4fd88afba6bc tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 95bf808e-8c6d-4702-b942-027288ec604a] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:50:59.266438 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-5426d0f3-2d06-45b6-a42c-4fd88afba6bc tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:59.267214 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-5426d0f3-2d06-45b6-a42c-4fd88afba6bc tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:59.268328 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-5426d0f3-2d06-45b6-a42c-4fd88afba6bc tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:59.268955 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-5426d0f3-2d06-45b6-a42c-4fd88afba6bc tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:59.286305 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [req-88278762-ba7f-4283-8030-a344aaed1a2c req-ef36d4af-000b-4570-810f-fe5dcd11f391 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "764ab5a7-4ebb-4d76-a34b-5f311883bcbe", "name": "network-vif-deleted", "tag": "e7989e60-2708-4f38-9de4-2ddeed675e74"}]} {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:50:59.301830 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [req-88278762-ba7f-4283-8030-a344aaed1a2c req-ef36d4af-000b-4570-810f-fe5dcd11f391 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:59.302347 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [req-88278762-ba7f-4283-8030-a344aaed1a2c req-ef36d4af-000b-4570-810f-fe5dcd11f391 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:59.318697 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.compute.server_external_events [req-88278762-ba7f-4283-8030-a344aaed1a2c req-ef36d4af-000b-4570-810f-fe5dcd11f391 service nova] Creating event network-vif-deleted:e7989e60-2708-4f38-9de4-2ddeed675e74 for instance 764ab5a7-4ebb-4d76-a34b-5f311883bcbe on hv-cinder-84902 Jul 19 15:50:59.323654 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [req-88278762-ba7f-4283-8030-a344aaed1a2c req-ef36d4af-000b-4570-810f-fe5dcd11f391 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043808 Jul 19 15:50:59.335915 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 357/772] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Jul 19 15:50:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:50:59.358236 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-5095bc79-0aeb-4e15-9206-98b1874e912a tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:50:59.360328 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-5095bc79-0aeb-4e15-9206-98b1874e912a tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: d1382aa7-6d93-410a-94ae-a7944114573f] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:50:59.367551 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-5095bc79-0aeb-4e15-9206-98b1874e912a tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:59.368213 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-5095bc79-0aeb-4e15-9206-98b1874e912a tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:59.369138 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-5095bc79-0aeb-4e15-9206-98b1874e912a tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:59.369571 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-5095bc79-0aeb-4e15-9206-98b1874e912a tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:59.405205 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-5095bc79-0aeb-4e15-9206-98b1874e912a tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/d1382aa7-6d93-410a-94ae-a7944114573f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052920 Jul 19 15:50:59.406323 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 358/773] 10.222.0.64 () {58 vars in 1301 bytes} [Tue Jul 19 15:50:59 2022] GET /compute/v2.1/servers/d1382aa7-6d93-410a-94ae-a7944114573f/os-volume_attachments => generated 25 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 19 15:50:59.441556 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-5426d0f3-2d06-45b6-a42c-4fd88afba6bc tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c75043813844d79fd0764132dfe4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e234f713b40cd8772372c2316dd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:50:59.449983 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-5426d0f3-2d06-45b6-a42c-4fd88afba6bc tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "GET /compute/v2.1/servers/95bf808e-8c6d-4702-b942-027288ec604a" status: 200 len: 1362 microversion: 2.1 time: 0.200679 Jul 19 15:50:59.454553 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 416/774] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:50:59 2022] GET /compute/v2.1/servers/95bf808e-8c6d-4702-b942-027288ec604a => generated 1362 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:50:59.467043 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-c3fe2fc4-8374-44b1-b41e-989afb35b54c tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:50:59.467544 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-c3fe2fc4-8374-44b1-b41e-989afb35b54c tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: d1382aa7-6d93-410a-94ae-a7944114573f] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:50:59.471303 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG dbcounter [-] [129519] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=4 {{(pid=129519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:50:59.475955 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-c3fe2fc4-8374-44b1-b41e-989afb35b54c tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:59.476413 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-c3fe2fc4-8374-44b1-b41e-989afb35b54c tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:59.477180 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-c3fe2fc4-8374-44b1-b41e-989afb35b54c tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:59.477617 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-c3fe2fc4-8374-44b1-b41e-989afb35b54c tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:59.502706 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-c3fe2fc4-8374-44b1-b41e-989afb35b54c tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: d1382aa7-6d93-410a-94ae-a7944114573f] Going to try to terminate instance {{(pid=129519) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 15:50:59.552769 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG dbcounter [-] [129519] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:50:59.583126 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-c3fe2fc4-8374-44b1-b41e-989afb35b54c tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "DELETE /compute/v2.1/servers/d1382aa7-6d93-410a-94ae-a7944114573f" status: 204 len: 0 microversion: 2.1 time: 0.119559 Jul 19 15:50:59.586774 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 359/775] 10.222.0.64 () {58 vars in 1238 bytes} [Tue Jul 19 15:50:59 2022] DELETE /compute/v2.1/servers/d1382aa7-6d93-410a-94ae-a7944114573f => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 15:50:59.591583 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-1d0ff624-b478-443a-8781-a191fa280a76 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:50:59.591983 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-acf4e5cf-b51a-4512-971e-b91f85086a40 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:50:59.592212 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-1d0ff624-b478-443a-8781-a191fa280a76 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 764ab5a7-4ebb-4d76-a34b-5f311883bcbe] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:50:59.592684 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-acf4e5cf-b51a-4512-971e-b91f85086a40 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: d1382aa7-6d93-410a-94ae-a7944114573f] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:50:59.599052 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-1d0ff624-b478-443a-8781-a191fa280a76 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:59.599489 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-1d0ff624-b478-443a-8781-a191fa280a76 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:59.599663 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-acf4e5cf-b51a-4512-971e-b91f85086a40 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:59.600120 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-acf4e5cf-b51a-4512-971e-b91f85086a40 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:59.600253 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-1d0ff624-b478-443a-8781-a191fa280a76 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:59.600659 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-1d0ff624-b478-443a-8781-a191fa280a76 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:59.600904 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-acf4e5cf-b51a-4512-971e-b91f85086a40 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:59.601347 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-acf4e5cf-b51a-4512-971e-b91f85086a40 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:59.639209 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-1d0ff624-b478-443a-8781-a191fa280a76 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:50:59.639516 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-1d0ff624-b478-443a-8781-a191fa280a76 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:50:59.640540 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.objects.instance [None req-1d0ff624-b478-443a-8781-a191fa280a76 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lazy-loading 'fault' on Instance uuid 764ab5a7-4ebb-4d76-a34b-5f311883bcbe {{(pid=129520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 15:50:59.686170 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-1d0ff624-b478-443a-8781-a191fa280a76 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:50:59.694597 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-1d0ff624-b478-443a-8781-a191fa280a76 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/764ab5a7-4ebb-4d76-a34b-5f311883bcbe" status: 200 len: 1312 microversion: 2.1 time: 0.106615 Jul 19 15:50:59.695089 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 417/776] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:50:59 2022] GET /compute/v2.1/servers/764ab5a7-4ebb-4d76-a34b-5f311883bcbe => generated 1312 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:50:59.756502 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-acf4e5cf-b51a-4512-971e-b91f85086a40 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7c42cf0bc84292bb0b7edb9f2e7fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a72d232f314a78b0e1c3f04b0ed682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:50:59.763961 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-acf4e5cf-b51a-4512-971e-b91f85086a40 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/d1382aa7-6d93-410a-94ae-a7944114573f" status: 200 len: 1681 microversion: 2.1 time: 0.176069 Jul 19 15:50:59.764646 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 360/777] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:50:59 2022] GET /compute/v2.1/servers/d1382aa7-6d93-410a-94ae-a7944114573f => generated 1681 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:51:00.160127 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-a25c1b01-ebda-41f3-8d89-350bb0f3aa62 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:00.160732 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-a25c1b01-ebda-41f3-8d89-350bb0f3aa62 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: df3309b1-ba0f-4f40-937f-fc95c9c8f6a0] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:00.167025 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-a25c1b01-ebda-41f3-8d89-350bb0f3aa62 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:00.167473 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-a25c1b01-ebda-41f3-8d89-350bb0f3aa62 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:00.168315 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-a25c1b01-ebda-41f3-8d89-350bb0f3aa62 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:00.168757 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-a25c1b01-ebda-41f3-8d89-350bb0f3aa62 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:00.300121 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-a25c1b01-ebda-41f3-8d89-350bb0f3aa62 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:00.308238 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-a25c1b01-ebda-41f3-8d89-350bb0f3aa62 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:00.309763 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-a25c1b01-ebda-41f3-8d89-350bb0f3aa62 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:00.310999 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-a25c1b01-ebda-41f3-8d89-350bb0f3aa62 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0" status: 200 len: 1725 microversion: 2.20 time: 0.155691 Jul 19 15:51:00.311556 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 418/778] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:51:00 2022] GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0 => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:51:00.467650 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-d189cc92-5c30-48c5-b20e-4ae4dc37c044 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:00.469486 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-d189cc92-5c30-48c5-b20e-4ae4dc37c044 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 95bf808e-8c6d-4702-b942-027288ec604a] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:00.476892 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-d189cc92-5c30-48c5-b20e-4ae4dc37c044 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:00.477583 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-d189cc92-5c30-48c5-b20e-4ae4dc37c044 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:00.478686 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-d189cc92-5c30-48c5-b20e-4ae4dc37c044 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:00.479197 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-d189cc92-5c30-48c5-b20e-4ae4dc37c044 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:00.611927 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-d189cc92-5c30-48c5-b20e-4ae4dc37c044 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c75043813844d79fd0764132dfe4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e234f713b40cd8772372c2316dd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:00.619343 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-d189cc92-5c30-48c5-b20e-4ae4dc37c044 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "GET /compute/v2.1/servers/95bf808e-8c6d-4702-b942-027288ec604a" status: 200 len: 1362 microversion: 2.1 time: 0.156438 Jul 19 15:51:00.619912 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 361/779] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:51:00 2022] GET /compute/v2.1/servers/95bf808e-8c6d-4702-b942-027288ec604a => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:51:00.712478 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-42edba54-e0e6-49ef-8711-908bd8a5e621 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:00.713076 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-42edba54-e0e6-49ef-8711-908bd8a5e621 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 764ab5a7-4ebb-4d76-a34b-5f311883bcbe] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:00.719640 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-42edba54-e0e6-49ef-8711-908bd8a5e621 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:00.720017 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-42edba54-e0e6-49ef-8711-908bd8a5e621 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:00.720768 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-42edba54-e0e6-49ef-8711-908bd8a5e621 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:00.721194 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-42edba54-e0e6-49ef-8711-908bd8a5e621 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:00.751975 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-42edba54-e0e6-49ef-8711-908bd8a5e621 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:00.752417 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-42edba54-e0e6-49ef-8711-908bd8a5e621 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:00.752903 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.objects.instance [None req-42edba54-e0e6-49ef-8711-908bd8a5e621 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lazy-loading 'fault' on Instance uuid 764ab5a7-4ebb-4d76-a34b-5f311883bcbe {{(pid=129520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 15:51:00.783412 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-3d65271c-7003-4f9f-bf3c-deb78dd015a3 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:00.784177 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-3d65271c-7003-4f9f-bf3c-deb78dd015a3 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: d1382aa7-6d93-410a-94ae-a7944114573f] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:00.790778 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-3d65271c-7003-4f9f-bf3c-deb78dd015a3 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:00.791256 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-3d65271c-7003-4f9f-bf3c-deb78dd015a3 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:00.792200 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-3d65271c-7003-4f9f-bf3c-deb78dd015a3 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:00.792824 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-3d65271c-7003-4f9f-bf3c-deb78dd015a3 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:00.795754 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-42edba54-e0e6-49ef-8711-908bd8a5e621 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4785719411fd4af892868d99fca7cd71', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a872b4eafae74b82896bd09229152104', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:00.803977 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-42edba54-e0e6-49ef-8711-908bd8a5e621 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/764ab5a7-4ebb-4d76-a34b-5f311883bcbe" status: 200 len: 1312 microversion: 2.1 time: 0.095341 Jul 19 15:51:00.813704 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 419/780] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:51:00 2022] GET /compute/v2.1/servers/764ab5a7-4ebb-4d76-a34b-5f311883bcbe => generated 1312 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:51:00.929720 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-3d65271c-7003-4f9f-bf3c-deb78dd015a3 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7c42cf0bc84292bb0b7edb9f2e7fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a72d232f314a78b0e1c3f04b0ed682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:00.938008 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-3d65271c-7003-4f9f-bf3c-deb78dd015a3 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/d1382aa7-6d93-410a-94ae-a7944114573f" status: 200 len: 1681 microversion: 2.1 time: 0.158635 Jul 19 15:51:00.939106 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 362/781] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:51:00 2022] GET /compute/v2.1/servers/d1382aa7-6d93-410a-94ae-a7944114573f => generated 1681 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:51:01.329236 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-1354e863-3fc9-44bc-aa42-ab1a2fd2c7fc tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:01.329891 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-1354e863-3fc9-44bc-aa42-ab1a2fd2c7fc tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: df3309b1-ba0f-4f40-937f-fc95c9c8f6a0] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:01.333482 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG dbcounter [-] [129520] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=2,nova_api:DELETE=2 {{(pid=129520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:51:01.337780 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-1354e863-3fc9-44bc-aa42-ab1a2fd2c7fc tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:01.338228 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-1354e863-3fc9-44bc-aa42-ab1a2fd2c7fc tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:01.339023 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-1354e863-3fc9-44bc-aa42-ab1a2fd2c7fc tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:01.339453 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-1354e863-3fc9-44bc-aa42-ab1a2fd2c7fc tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:01.470792 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-1354e863-3fc9-44bc-aa42-ab1a2fd2c7fc tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:01.478815 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-1354e863-3fc9-44bc-aa42-ab1a2fd2c7fc tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:01.480327 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-1354e863-3fc9-44bc-aa42-ab1a2fd2c7fc tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:01.481588 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-1354e863-3fc9-44bc-aa42-ab1a2fd2c7fc tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0" status: 200 len: 1746 microversion: 2.20 time: 0.156359 Jul 19 15:51:01.482159 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 420/782] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:51:01 2022] GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0 => generated 1746 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:51:01.636946 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-ff1c9215-e91b-4a58-ba9d-8acb1c19e96e tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:01.637551 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-ff1c9215-e91b-4a58-ba9d-8acb1c19e96e tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 95bf808e-8c6d-4702-b942-027288ec604a] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:01.644322 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-ff1c9215-e91b-4a58-ba9d-8acb1c19e96e tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:01.644774 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-ff1c9215-e91b-4a58-ba9d-8acb1c19e96e tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:01.645528 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-ff1c9215-e91b-4a58-ba9d-8acb1c19e96e tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:01.645969 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-ff1c9215-e91b-4a58-ba9d-8acb1c19e96e tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:01.785296 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-ff1c9215-e91b-4a58-ba9d-8acb1c19e96e tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c75043813844d79fd0764132dfe4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e234f713b40cd8772372c2316dd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:01.792931 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-ff1c9215-e91b-4a58-ba9d-8acb1c19e96e tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "GET /compute/v2.1/servers/95bf808e-8c6d-4702-b942-027288ec604a" status: 200 len: 1362 microversion: 2.1 time: 0.159825 Jul 19 15:51:01.793482 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 363/783] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:51:01 2022] GET /compute/v2.1/servers/95bf808e-8c6d-4702-b942-027288ec604a => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:51:01.821108 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-128fbb38-1d91-4370-92e5-0e2a78de25f9 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:01.821748 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-128fbb38-1d91-4370-92e5-0e2a78de25f9 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] [instance: 764ab5a7-4ebb-4d76-a34b-5f311883bcbe] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:01.828032 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-128fbb38-1d91-4370-92e5-0e2a78de25f9 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:01.828481 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-128fbb38-1d91-4370-92e5-0e2a78de25f9 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:01.829250 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-128fbb38-1d91-4370-92e5-0e2a78de25f9 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:01.829690 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-128fbb38-1d91-4370-92e5-0e2a78de25f9 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:01.842633 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.wsgi [None req-128fbb38-1d91-4370-92e5-0e2a78de25f9 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] HTTP exception thrown: Instance 764ab5a7-4ebb-4d76-a34b-5f311883bcbe could not be found. Jul 19 15:51:01.844389 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-128fbb38-1d91-4370-92e5-0e2a78de25f9 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Request method failure captured: Jul 19 15:51:01.844389 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: request: GET /compute/v2.1/servers/764ab5a7-4ebb-4d76-a34b-5f311883bcbe HTTP/1.1 Jul 19 15:51:01.844389 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Accept: application/json Jul 19 15:51:01.844389 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Accept-Encoding: identity Jul 19 15:51:01.844389 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Connection: close Jul 19 15:51:01.844389 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Content-Length: 0 Jul 19 15:51:01.844389 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Content-Type: application/json Jul 19 15:51:01.844389 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Host: 10.222.0.64 Jul 19 15:51:01.844389 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Openstack-System-Scope: None Jul 19 15:51:01.844389 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: User-Agent: python-urllib3/1.26.9 Jul 19 15:51:01.844389 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Auth-Token: gAAAAABi1tGPG3TL2GwfAc0kf5LaV9cX4pbJFxTWqQKwJFE5MwZWkdPruymWghvL56VHYnPjmTX00Dxb6n-I5a-K8qDlTUL3Rdjijr9hGViaVz0EvfiTyEi0NIlocc44JNIONZOhLldSNTzzdFWiWGRLTkuRKHFmrDA7ImfJvTM2riB9cOts4j4 Jul 19 15:51:01.844389 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Domain-Id: None Jul 19 15:51:01.844389 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Domain-Name: None Jul 19 15:51:01.844389 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Identity-Status: Confirmed Jul 19 15:51:01.844389 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Is-Admin-Project: True Jul 19 15:51:01.844389 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Project-Domain-Id: default Jul 19 15:51:01.844389 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Project-Domain-Name: Default Jul 19 15:51:01.844389 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Project-Id: a872b4eafae74b82896bd09229152104 Jul 19 15:51:01.844389 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1658676 Jul 19 15:51:01.844389 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Role: member,reader Jul 19 15:51:01.844389 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Roles: member,reader Jul 19 15:51:01.845715 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_a872b4eafae74b82896bd09229152104", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a872b4eafae74b82896bd09229152104"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/a872b4eafae74b82896bd09229152104"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/a872b4eafae74b82896bd09229152104"}]}] Jul 19 15:51:01.845715 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1658676 Jul 19 15:51:01.845715 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Tenant-Id: a872b4eafae74b82896bd09229152104 Jul 19 15:51:01.845715 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1658676 Jul 19 15:51:01.845715 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User: tempest-ServerRescueNegativeTestJSON-1658676-project Jul 19 15:51:01.845715 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User-Domain-Id: default Jul 19 15:51:01.845715 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User-Domain-Name: Default Jul 19 15:51:01.845715 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User-Id: 4785719411fd4af892868d99fca7cd71 Jul 19 15:51:01.845715 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1658676-project Jul 19 15:51:01.845715 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: method: > Jul 19 15:51:01.845715 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: exception: Instance 764ab5a7-4ebb-4d76-a34b-5f311883bcbe could not be found. Jul 19 15:51:01.845715 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: action_args: {'id': '764ab5a7-4ebb-4d76-a34b-5f311883bcbe'} Jul 19 15:51:01.846524 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:51:01.846524 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:51:01.846524 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 15:51:01.846524 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 15:51:01.846524 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 15:51:01.846524 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 15:51:01.846524 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 15:51:01.846524 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 15:51:01.846524 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 15:51:01.846524 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 15:51:01.846524 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 764ab5a7-4ebb-4d76-a34b-5f311883bcbe could not be found. Jul 19 15:51:01.846524 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:51:01.846524 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:51:01.846524 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:51:01.846524 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:51:01.846524 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:51:01.846524 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:51:01.846524 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:51:01.846524 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:51:01.846524 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:51:01.847719 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:51:01.847719 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 15:51:01.847719 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 15:51:01.847719 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 15:51:01.847719 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 15:51:01.847719 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 15:51:01.847719 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 15:51:01.847719 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 764ab5a7-4ebb-4d76-a34b-5f311883bcbe could not be found. Jul 19 15:51:01.847719 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:51:01.847719 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:51:01.847719 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:51:01.847719 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:51:01.847719 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:51:01.847719 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:51:01.847719 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:51:01.847719 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:51:01.847719 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 764ab5a7-4ebb-4d76-a34b-5f311883bcbe could not be found. Jul 19 15:51:01.847719 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:51:01.848758 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-128fbb38-1d91-4370-92e5-0e2a78de25f9 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] Returning 404 to user: Instance 764ab5a7-4ebb-4d76-a34b-5f311883bcbe could not be found. {{(pid=129520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:51:01.848758 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-128fbb38-1d91-4370-92e5-0e2a78de25f9 tempest-ServerRescueNegativeTestJSON-1658676 tempest-ServerRescueNegativeTestJSON-1658676-project] 10.222.0.64 "GET /compute/v2.1/servers/764ab5a7-4ebb-4d76-a34b-5f311883bcbe" status: 404 len: 111 microversion: 2.1 time: 0.028561 Jul 19 15:51:01.848758 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 421/784] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:51:01 2022] GET /compute/v2.1/servers/764ab5a7-4ebb-4d76-a34b-5f311883bcbe => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 15:51:01.955837 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-616efb47-7051-441a-a9c2-7483715f8257 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:01.956447 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-616efb47-7051-441a-a9c2-7483715f8257 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: d1382aa7-6d93-410a-94ae-a7944114573f] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:01.962451 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-616efb47-7051-441a-a9c2-7483715f8257 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:01.962902 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-616efb47-7051-441a-a9c2-7483715f8257 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:01.963672 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-616efb47-7051-441a-a9c2-7483715f8257 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:01.964106 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-616efb47-7051-441a-a9c2-7483715f8257 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:02.099634 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-616efb47-7051-441a-a9c2-7483715f8257 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7c42cf0bc84292bb0b7edb9f2e7fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a72d232f314a78b0e1c3f04b0ed682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:02.107034 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-616efb47-7051-441a-a9c2-7483715f8257 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/d1382aa7-6d93-410a-94ae-a7944114573f" status: 200 len: 1681 microversion: 2.1 time: 0.155406 Jul 19 15:51:02.107597 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 364/785] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:51:01 2022] GET /compute/v2.1/servers/d1382aa7-6d93-410a-94ae-a7944114573f => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:51:02.501104 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-fa3c1c82-edea-4238-973d-379cd33639ef tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:02.501645 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-fa3c1c82-edea-4238-973d-379cd33639ef tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: df3309b1-ba0f-4f40-937f-fc95c9c8f6a0] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:02.508179 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-fa3c1c82-edea-4238-973d-379cd33639ef tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:02.508630 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-fa3c1c82-edea-4238-973d-379cd33639ef tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:02.509399 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-fa3c1c82-edea-4238-973d-379cd33639ef tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:02.509836 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-fa3c1c82-edea-4238-973d-379cd33639ef tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:02.667492 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG dbcounter [-] [129519] Writing DB stats nova_cell0:SELECT=2 {{(pid=129519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:51:02.668805 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG dbcounter [-] [129519] Writing DB stats nova_cell0:SELECT=12 {{(pid=129519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:51:02.739430 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [req-c6abdd8d-9983-4c28-856e-ea642cd99b35 req-2b061dbf-c830-4aaf-9fe5-200e06059084 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df3309b1-ba0f-4f40-937f-fc95c9c8f6a0", "name": "network-vif-plugged", "status": "completed", "tag": "f79bc5b8-5b78-4990-ae5f-977bb42032bd"}]} {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:51:02.750734 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [req-c6abdd8d-9983-4c28-856e-ea642cd99b35 req-2b061dbf-c830-4aaf-9fe5-200e06059084 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:02.751518 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [req-c6abdd8d-9983-4c28-856e-ea642cd99b35 req-2b061dbf-c830-4aaf-9fe5-200e06059084 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:02.765286 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.compute.server_external_events [req-c6abdd8d-9983-4c28-856e-ea642cd99b35 req-2b061dbf-c830-4aaf-9fe5-200e06059084 service nova] Creating event network-vif-plugged:f79bc5b8-5b78-4990-ae5f-977bb42032bd for instance df3309b1-ba0f-4f40-937f-fc95c9c8f6a0 on hv-cinder-84902 Jul 19 15:51:02.771975 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [req-c6abdd8d-9983-4c28-856e-ea642cd99b35 req-2b061dbf-c830-4aaf-9fe5-200e06059084 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109340 Jul 19 15:51:02.773114 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 365/786] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Jul 19 15:51:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 15:51:02.811667 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-7d3046d4-3c40-42ea-8eb1-11c585f16d1f tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:02.812456 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-7d3046d4-3c40-42ea-8eb1-11c585f16d1f tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 95bf808e-8c6d-4702-b942-027288ec604a] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:02.819237 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-7d3046d4-3c40-42ea-8eb1-11c585f16d1f tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:02.819759 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-7d3046d4-3c40-42ea-8eb1-11c585f16d1f tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:02.820678 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-7d3046d4-3c40-42ea-8eb1-11c585f16d1f tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:02.821124 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-7d3046d4-3c40-42ea-8eb1-11c585f16d1f tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:02.976253 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-7d3046d4-3c40-42ea-8eb1-11c585f16d1f tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c75043813844d79fd0764132dfe4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e234f713b40cd8772372c2316dd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:02.988398 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-7d3046d4-3c40-42ea-8eb1-11c585f16d1f tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "GET /compute/v2.1/servers/95bf808e-8c6d-4702-b942-027288ec604a" status: 200 len: 1362 microversion: 2.1 time: 0.181043 Jul 19 15:51:02.989173 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 366/787] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:51:02 2022] GET /compute/v2.1/servers/95bf808e-8c6d-4702-b942-027288ec604a => generated 1362 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:51:03.099789 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-fa3c1c82-edea-4238-973d-379cd33639ef tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:03.110963 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-fa3c1c82-edea-4238-973d-379cd33639ef tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:03.112838 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-fa3c1c82-edea-4238-973d-379cd33639ef tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:03.114143 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-fa3c1c82-edea-4238-973d-379cd33639ef tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0" status: 200 len: 1746 microversion: 2.20 time: 0.617666 Jul 19 15:51:03.114869 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 422/788] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:51:02 2022] GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0 => generated 1746 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:51:03.126393 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-cff00264-cbb6-4f21-ae22-73d90c7dd98c tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:03.127015 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-cff00264-cbb6-4f21-ae22-73d90c7dd98c tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: d1382aa7-6d93-410a-94ae-a7944114573f] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:03.133194 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-cff00264-cbb6-4f21-ae22-73d90c7dd98c tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:03.133722 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-cff00264-cbb6-4f21-ae22-73d90c7dd98c tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:03.134614 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-cff00264-cbb6-4f21-ae22-73d90c7dd98c tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:03.135121 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-cff00264-cbb6-4f21-ae22-73d90c7dd98c tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:03.268599 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-cff00264-cbb6-4f21-ae22-73d90c7dd98c tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7c42cf0bc84292bb0b7edb9f2e7fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a72d232f314a78b0e1c3f04b0ed682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:03.276509 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-cff00264-cbb6-4f21-ae22-73d90c7dd98c tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/d1382aa7-6d93-410a-94ae-a7944114573f" status: 200 len: 1681 microversion: 2.1 time: 0.154345 Jul 19 15:51:03.277155 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 367/789] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:51:03 2022] GET /compute/v2.1/servers/d1382aa7-6d93-410a-94ae-a7944114573f => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:51:03.824970 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [req-706e10e3-340b-44df-acb9-0c0a5c48b3a1 req-ceb606a1-2d6d-4ea3-857a-693e81842e86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d1382aa7-6d93-410a-94ae-a7944114573f", "name": "network-vif-deleted", "tag": "baf9abd3-9c5d-45c3-81b3-843072591796"}]} {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:51:03.837478 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [req-706e10e3-340b-44df-acb9-0c0a5c48b3a1 req-ceb606a1-2d6d-4ea3-857a-693e81842e86 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:03.837928 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [req-706e10e3-340b-44df-acb9-0c0a5c48b3a1 req-ceb606a1-2d6d-4ea3-857a-693e81842e86 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:03.858771 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.compute.server_external_events [req-706e10e3-340b-44df-acb9-0c0a5c48b3a1 req-ceb606a1-2d6d-4ea3-857a-693e81842e86 service nova] Creating event network-vif-deleted:baf9abd3-9c5d-45c3-81b3-843072591796 for instance d1382aa7-6d93-410a-94ae-a7944114573f on hv-cinder-84902 Jul 19 15:51:03.871831 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [req-706e10e3-340b-44df-acb9-0c0a5c48b3a1 req-ceb606a1-2d6d-4ea3-857a-693e81842e86 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050659 Jul 19 15:51:03.876823 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 423/790] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Jul 19 15:51:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:51:04.012339 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-85d7cf74-a0ed-4e2a-929e-95125e9d0540 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:04.013020 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-85d7cf74-a0ed-4e2a-929e-95125e9d0540 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 95bf808e-8c6d-4702-b942-027288ec604a] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:04.022757 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-85d7cf74-a0ed-4e2a-929e-95125e9d0540 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:04.023667 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-85d7cf74-a0ed-4e2a-929e-95125e9d0540 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:04.024604 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-85d7cf74-a0ed-4e2a-929e-95125e9d0540 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:04.025258 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-85d7cf74-a0ed-4e2a-929e-95125e9d0540 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:04.133563 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-951fb8e1-fa21-4a1d-9e1b-b4ad5af99553 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:04.134663 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-951fb8e1-fa21-4a1d-9e1b-b4ad5af99553 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: df3309b1-ba0f-4f40-937f-fc95c9c8f6a0] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:04.146486 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-951fb8e1-fa21-4a1d-9e1b-b4ad5af99553 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:04.147962 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-951fb8e1-fa21-4a1d-9e1b-b4ad5af99553 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:04.149011 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-951fb8e1-fa21-4a1d-9e1b-b4ad5af99553 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:04.150339 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-951fb8e1-fa21-4a1d-9e1b-b4ad5af99553 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:04.331626 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-85d7cf74-a0ed-4e2a-929e-95125e9d0540 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c75043813844d79fd0764132dfe4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e234f713b40cd8772372c2316dd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:04.341335 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-85d7cf74-a0ed-4e2a-929e-95125e9d0540 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "GET /compute/v2.1/servers/95bf808e-8c6d-4702-b942-027288ec604a" status: 200 len: 1362 microversion: 2.1 time: 0.338847 Jul 19 15:51:04.353392 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 368/791] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:51:04 2022] GET /compute/v2.1/servers/95bf808e-8c6d-4702-b942-027288ec604a => generated 1362 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:51:04.358749 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-f889fbc3-c063-4e98-bd37-b845b79d91bf tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:04.359658 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-f889fbc3-c063-4e98-bd37-b845b79d91bf tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: d1382aa7-6d93-410a-94ae-a7944114573f] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:04.370073 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-f889fbc3-c063-4e98-bd37-b845b79d91bf tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:04.372993 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-f889fbc3-c063-4e98-bd37-b845b79d91bf tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:04.376837 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-f889fbc3-c063-4e98-bd37-b845b79d91bf tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:04.378471 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-f889fbc3-c063-4e98-bd37-b845b79d91bf tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:04.444719 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-f889fbc3-c063-4e98-bd37-b845b79d91bf tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:04.445291 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-f889fbc3-c063-4e98-bd37-b845b79d91bf tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:04.446014 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.objects.instance [None req-f889fbc3-c063-4e98-bd37-b845b79d91bf tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lazy-loading 'fault' on Instance uuid d1382aa7-6d93-410a-94ae-a7944114573f {{(pid=129519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 15:51:04.503665 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-f889fbc3-c063-4e98-bd37-b845b79d91bf tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7c42cf0bc84292bb0b7edb9f2e7fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a72d232f314a78b0e1c3f04b0ed682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:04.512811 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-f889fbc3-c063-4e98-bd37-b845b79d91bf tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/d1382aa7-6d93-410a-94ae-a7944114573f" status: 200 len: 1330 microversion: 2.1 time: 0.158105 Jul 19 15:51:04.514123 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-951fb8e1-fa21-4a1d-9e1b-b4ad5af99553 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:04.514293 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 369/792] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:51:04 2022] GET /compute/v2.1/servers/d1382aa7-6d93-410a-94ae-a7944114573f => generated 1330 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:51:04.519525 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-f91a9e49-37a2-4cd1-abd8-98e1d66988e9 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:04.520125 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-f91a9e49-37a2-4cd1-abd8-98e1d66988e9 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] [instance: 17f9fd89-e668-4d3d-8d85-e648189ba0c2] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:04.527983 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-f91a9e49-37a2-4cd1-abd8-98e1d66988e9 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:04.529588 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-f91a9e49-37a2-4cd1-abd8-98e1d66988e9 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:04.531817 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-f91a9e49-37a2-4cd1-abd8-98e1d66988e9 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:04.532705 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-951fb8e1-fa21-4a1d-9e1b-b4ad5af99553 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:04.532941 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-f91a9e49-37a2-4cd1-abd8-98e1d66988e9 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:04.537264 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-951fb8e1-fa21-4a1d-9e1b-b4ad5af99553 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:04.539838 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-951fb8e1-fa21-4a1d-9e1b-b4ad5af99553 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0" status: 200 len: 1741 microversion: 2.20 time: 0.410280 Jul 19 15:51:04.540420 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 424/793] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:51:04 2022] GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0 => generated 1741 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 15:51:04.573180 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-f91a9e49-37a2-4cd1-abd8-98e1d66988e9 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] [instance: 17f9fd89-e668-4d3d-8d85-e648189ba0c2] Going to try to terminate instance {{(pid=129519) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 15:51:04.718093 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-f91a9e49-37a2-4cd1-abd8-98e1d66988e9 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] 10.222.0.64 "DELETE /compute/v2.1/servers/17f9fd89-e668-4d3d-8d85-e648189ba0c2" status: 204 len: 0 microversion: 2.1 time: 0.202267 Jul 19 15:51:04.721309 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 370/794] 10.222.0.64 () {58 vars in 1238 bytes} [Tue Jul 19 15:51:04 2022] DELETE /compute/v2.1/servers/17f9fd89-e668-4d3d-8d85-e648189ba0c2 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 15:51:04.732662 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-a60607b5-f5f0-4718-9a75-7beedef06ced tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:04.733308 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-a60607b5-f5f0-4718-9a75-7beedef06ced tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] [instance: 17f9fd89-e668-4d3d-8d85-e648189ba0c2] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:04.742551 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-a60607b5-f5f0-4718-9a75-7beedef06ced tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:04.743011 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-a60607b5-f5f0-4718-9a75-7beedef06ced tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:04.743789 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-a60607b5-f5f0-4718-9a75-7beedef06ced tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:04.744402 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-a60607b5-f5f0-4718-9a75-7beedef06ced tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:04.878221 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [req-4ac78747-3c3f-4def-97e3-d932457a15bf req-261f92fe-a91b-491e-9523-b7d734fe22ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95bf808e-8c6d-4702-b942-027288ec604a", "name": "network-vif-plugged", "status": "completed", "tag": "ebbcf9c9-0a61-4248-af0f-40d0e408b9f3"}]} {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:51:04.922114 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [req-4ac78747-3c3f-4def-97e3-d932457a15bf req-261f92fe-a91b-491e-9523-b7d734fe22ac service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:04.926102 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [req-4ac78747-3c3f-4def-97e3-d932457a15bf req-261f92fe-a91b-491e-9523-b7d734fe22ac service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:04.957250 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-a60607b5-f5f0-4718-9a75-7beedef06ced tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae334c4d93cd4d3e94789a5985fcfa77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6827afcdf1f3481882f808dc01908a4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:04.966141 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-a60607b5-f5f0-4718-9a75-7beedef06ced tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] 10.222.0.64 "GET /compute/v2.1/servers/17f9fd89-e668-4d3d-8d85-e648189ba0c2" status: 200 len: 1576 microversion: 2.1 time: 0.240335 Jul 19 15:51:04.970552 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.compute.server_external_events [req-4ac78747-3c3f-4def-97e3-d932457a15bf req-261f92fe-a91b-491e-9523-b7d734fe22ac service nova] Creating event network-vif-plugged:ebbcf9c9-0a61-4248-af0f-40d0e408b9f3 for instance 95bf808e-8c6d-4702-b942-027288ec604a on hv-cinder-84902 Jul 19 15:51:04.971122 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 425/795] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:51:04 2022] GET /compute/v2.1/servers/17f9fd89-e668-4d3d-8d85-e648189ba0c2 => generated 1576 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:51:04.977225 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [req-4ac78747-3c3f-4def-97e3-d932457a15bf req-261f92fe-a91b-491e-9523-b7d734fe22ac service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103755 Jul 19 15:51:04.977945 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 371/796] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Jul 19 15:51:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 15:51:05.368971 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-7d2e79d8-7060-4300-a0d1-7bfc40504a56 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:05.369710 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-7d2e79d8-7060-4300-a0d1-7bfc40504a56 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 95bf808e-8c6d-4702-b942-027288ec604a] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:05.377505 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-7d2e79d8-7060-4300-a0d1-7bfc40504a56 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:05.382295 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-7d2e79d8-7060-4300-a0d1-7bfc40504a56 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:05.384031 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-7d2e79d8-7060-4300-a0d1-7bfc40504a56 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:05.386702 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-7d2e79d8-7060-4300-a0d1-7bfc40504a56 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:05.532193 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-bd5eccbb-19a0-4362-8c60-17e052601f52 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:05.532956 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-bd5eccbb-19a0-4362-8c60-17e052601f52 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: d1382aa7-6d93-410a-94ae-a7944114573f] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:05.543112 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-bd5eccbb-19a0-4362-8c60-17e052601f52 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:05.543555 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-bd5eccbb-19a0-4362-8c60-17e052601f52 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:05.544326 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-bd5eccbb-19a0-4362-8c60-17e052601f52 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:05.544756 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-bd5eccbb-19a0-4362-8c60-17e052601f52 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:05.593018 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.wsgi [None req-bd5eccbb-19a0-4362-8c60-17e052601f52 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] HTTP exception thrown: Instance d1382aa7-6d93-410a-94ae-a7944114573f could not be found. Jul 19 15:51:05.608356 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-bd5eccbb-19a0-4362-8c60-17e052601f52 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Request method failure captured: Jul 19 15:51:05.608356 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: request: GET /compute/v2.1/servers/d1382aa7-6d93-410a-94ae-a7944114573f HTTP/1.1 Jul 19 15:51:05.608356 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Accept: application/json Jul 19 15:51:05.608356 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Accept-Encoding: identity Jul 19 15:51:05.608356 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Connection: close Jul 19 15:51:05.608356 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Content-Length: 0 Jul 19 15:51:05.608356 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Content-Type: application/json Jul 19 15:51:05.608356 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Host: 10.222.0.64 Jul 19 15:51:05.608356 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Openstack-System-Scope: None Jul 19 15:51:05.608356 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: User-Agent: python-urllib3/1.26.9 Jul 19 15:51:05.608356 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Auth-Token: gAAAAABi1tGPtVnrBLo0yCDS-Fxp117KmoW30EOrAzeE-HWJZTaOLzmdVU7ilJLT24AK1cNZoT6hZsY9VJG83Xk6FPFrebHG3s54Fuj7pMRO-j7b_NklvH50XPBLW-GpDpGZ3ebrTqCiTKXUJEZA0zlfYPmMdreiVMLme-IYyDlHVZle_DtpLr0 Jul 19 15:51:05.608356 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Domain-Id: None Jul 19 15:51:05.608356 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Domain-Name: None Jul 19 15:51:05.608356 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Identity-Status: Confirmed Jul 19 15:51:05.608356 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Is-Admin-Project: True Jul 19 15:51:05.608356 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Domain-Id: default Jul 19 15:51:05.608356 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Domain-Name: Default Jul 19 15:51:05.608356 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Id: 45a72d232f314a78b0e1c3f04b0ed682 Jul 19 15:51:05.608356 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Name: tempest-AttachVolumeNegativeTest-1922780758 Jul 19 15:51:05.608356 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Role: member,reader Jul 19 15:51:05.608356 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Roles: member,reader Jul 19 15:51:05.610607 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_45a72d232f314a78b0e1c3f04b0ed682", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/45a72d232f314a78b0e1c3f04b0ed682"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/45a72d232f314a78b0e1c3f04b0ed682"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/45a72d232f314a78b0e1c3f04b0ed682"}]}] Jul 19 15:51:05.610607 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Tenant: tempest-AttachVolumeNegativeTest-1922780758 Jul 19 15:51:05.610607 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Tenant-Id: 45a72d232f314a78b0e1c3f04b0ed682 Jul 19 15:51:05.610607 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1922780758 Jul 19 15:51:05.610607 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User: tempest-AttachVolumeNegativeTest-1922780758-project Jul 19 15:51:05.610607 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Domain-Id: default Jul 19 15:51:05.610607 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Domain-Name: Default Jul 19 15:51:05.610607 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Id: 2d7c42cf0bc84292bb0b7edb9f2e7fc3 Jul 19 15:51:05.610607 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Name: tempest-AttachVolumeNegativeTest-1922780758-project Jul 19 15:51:05.610607 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: method: > Jul 19 15:51:05.610607 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: exception: Instance d1382aa7-6d93-410a-94ae-a7944114573f could not be found. Jul 19 15:51:05.610607 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: action_args: {'id': 'd1382aa7-6d93-410a-94ae-a7944114573f'} Jul 19 15:51:05.611386 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:51:05.611386 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:51:05.611386 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 15:51:05.611386 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 15:51:05.611386 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 15:51:05.611386 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 15:51:05.611386 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 15:51:05.611386 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 15:51:05.611386 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 15:51:05.611386 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 15:51:05.611386 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1382aa7-6d93-410a-94ae-a7944114573f could not be found. Jul 19 15:51:05.611386 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:51:05.611386 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:51:05.611386 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:51:05.611386 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:51:05.611386 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:51:05.611386 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:51:05.611386 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:51:05.611386 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:51:05.611386 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:51:05.612606 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:51:05.612606 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 15:51:05.612606 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 15:51:05.612606 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 15:51:05.612606 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 15:51:05.612606 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 15:51:05.612606 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 15:51:05.612606 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1382aa7-6d93-410a-94ae-a7944114573f could not be found. Jul 19 15:51:05.612606 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:51:05.612606 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:51:05.612606 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:51:05.612606 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:51:05.612606 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:51:05.612606 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:51:05.612606 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:51:05.612606 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:51:05.612606 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1382aa7-6d93-410a-94ae-a7944114573f could not be found. Jul 19 15:51:05.612606 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:51:05.615284 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-bd5eccbb-19a0-4362-8c60-17e052601f52 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Returning 404 to user: Instance d1382aa7-6d93-410a-94ae-a7944114573f could not be found. {{(pid=129519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:51:05.619008 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-bd5eccbb-19a0-4362-8c60-17e052601f52 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/d1382aa7-6d93-410a-94ae-a7944114573f" status: 404 len: 111 microversion: 2.1 time: 0.092163 Jul 19 15:51:05.630214 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-7d2e79d8-7060-4300-a0d1-7bfc40504a56 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c75043813844d79fd0764132dfe4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e234f713b40cd8772372c2316dd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:05.635672 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 372/797] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:51:05 2022] GET /compute/v2.1/servers/d1382aa7-6d93-410a-94ae-a7944114573f => generated 111 bytes in 110 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 15:51:05.640005 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-7d2e79d8-7060-4300-a0d1-7bfc40504a56 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "GET /compute/v2.1/servers/95bf808e-8c6d-4702-b942-027288ec604a" status: 200 len: 1362 microversion: 2.1 time: 0.274863 Jul 19 15:51:05.641931 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 426/798] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:51:05 2022] GET /compute/v2.1/servers/95bf808e-8c6d-4702-b942-027288ec604a => generated 1362 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:51:05.646882 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-58e6a1ae-8794-4f10-b9d7-694b48c5fa59 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '.version_select at 0x7fb8a5a628b0>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:05.655816 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-87769972-5daa-4697-9671-ca22e0b3d231 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:05.656895 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-87769972-5daa-4697-9671-ca22e0b3d231 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: df3309b1-ba0f-4f40-937f-fc95c9c8f6a0] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:05.677329 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-87769972-5daa-4697-9671-ca22e0b3d231 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:05.684559 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-87769972-5daa-4697-9671-ca22e0b3d231 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:05.690337 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-87769972-5daa-4697-9671-ca22e0b3d231 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:05.692008 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-87769972-5daa-4697-9671-ca22e0b3d231 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:05.693096 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-58e6a1ae-8794-4f10-b9d7-694b48c5fa59 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-582431366" status: 202 len: 0 microversion: 2.1 time: 0.049795 Jul 19 15:51:05.694411 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 427/799] 10.222.0.64 () {58 vars in 1217 bytes} [Tue Jul 19 15:51:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-582431366 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 15:51:05.986618 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-9df7d4ab-edb2-4fc9-85d2-3e441dfc1c77 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:05.987575 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-9df7d4ab-edb2-4fc9-85d2-3e441dfc1c77 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] [instance: 17f9fd89-e668-4d3d-8d85-e648189ba0c2] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:05.997008 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-9df7d4ab-edb2-4fc9-85d2-3e441dfc1c77 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:05.999392 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-9df7d4ab-edb2-4fc9-85d2-3e441dfc1c77 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:06.005816 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-9df7d4ab-edb2-4fc9-85d2-3e441dfc1c77 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:06.008721 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-9df7d4ab-edb2-4fc9-85d2-3e441dfc1c77 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:06.118459 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-87769972-5daa-4697-9671-ca22e0b3d231 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:06.128284 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-87769972-5daa-4697-9671-ca22e0b3d231 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:06.139558 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-87769972-5daa-4697-9671-ca22e0b3d231 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:06.141045 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-87769972-5daa-4697-9671-ca22e0b3d231 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0" status: 200 len: 1741 microversion: 2.20 time: 0.497811 Jul 19 15:51:06.151982 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 373/800] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:51:05 2022] GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0 => generated 1741 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:51:06.264762 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-9df7d4ab-edb2-4fc9-85d2-3e441dfc1c77 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae334c4d93cd4d3e94789a5985fcfa77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6827afcdf1f3481882f808dc01908a4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:06.272896 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-9df7d4ab-edb2-4fc9-85d2-3e441dfc1c77 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] 10.222.0.64 "GET /compute/v2.1/servers/17f9fd89-e668-4d3d-8d85-e648189ba0c2" status: 200 len: 1576 microversion: 2.1 time: 0.290715 Jul 19 15:51:06.283739 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 428/801] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:51:05 2022] GET /compute/v2.1/servers/17f9fd89-e668-4d3d-8d85-e648189ba0c2 => generated 1576 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:51:06.657779 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-3b7ab82a-b30d-487d-ac0c-85bb9df789e2 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:06.658400 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-3b7ab82a-b30d-487d-ac0c-85bb9df789e2 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 95bf808e-8c6d-4702-b942-027288ec604a] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:06.665124 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-3b7ab82a-b30d-487d-ac0c-85bb9df789e2 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:06.665534 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-3b7ab82a-b30d-487d-ac0c-85bb9df789e2 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:06.667884 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-3b7ab82a-b30d-487d-ac0c-85bb9df789e2 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:06.674412 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-3b7ab82a-b30d-487d-ac0c-85bb9df789e2 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:07.162846 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-c012ff0f-0b46-4cce-af26-68b42669b633 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:07.164366 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-c012ff0f-0b46-4cce-af26-68b42669b633 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: df3309b1-ba0f-4f40-937f-fc95c9c8f6a0] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:07.172825 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-c012ff0f-0b46-4cce-af26-68b42669b633 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:07.173303 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-c012ff0f-0b46-4cce-af26-68b42669b633 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:07.174229 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-c012ff0f-0b46-4cce-af26-68b42669b633 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:07.174692 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-c012ff0f-0b46-4cce-af26-68b42669b633 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:07.275256 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-3b7ab82a-b30d-487d-ac0c-85bb9df789e2 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c75043813844d79fd0764132dfe4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e234f713b40cd8772372c2316dd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:07.292751 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-3b7ab82a-b30d-487d-ac0c-85bb9df789e2 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "GET /compute/v2.1/servers/95bf808e-8c6d-4702-b942-027288ec604a" status: 200 len: 1362 microversion: 2.1 time: 0.637569 Jul 19 15:51:07.296614 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 374/802] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:51:06 2022] GET /compute/v2.1/servers/95bf808e-8c6d-4702-b942-027288ec604a => generated 1362 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:51:07.305304 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-10358a0f-e49f-4948-84b1-11b24f10231d tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:07.306333 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-10358a0f-e49f-4948-84b1-11b24f10231d tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] [instance: 17f9fd89-e668-4d3d-8d85-e648189ba0c2] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:07.331401 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-10358a0f-e49f-4948-84b1-11b24f10231d tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:07.332633 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-10358a0f-e49f-4948-84b1-11b24f10231d tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:07.335004 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-10358a0f-e49f-4948-84b1-11b24f10231d tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:07.336721 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-10358a0f-e49f-4948-84b1-11b24f10231d tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:07.425117 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-c012ff0f-0b46-4cce-af26-68b42669b633 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:07.440514 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-c012ff0f-0b46-4cce-af26-68b42669b633 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:07.442046 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-c012ff0f-0b46-4cce-af26-68b42669b633 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:07.443266 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-c012ff0f-0b46-4cce-af26-68b42669b633 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0" status: 200 len: 1741 microversion: 2.20 time: 0.287609 Jul 19 15:51:07.449181 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 429/803] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:51:07 2022] GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0 => generated 1741 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:51:07.736156 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-10358a0f-e49f-4948-84b1-11b24f10231d tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae334c4d93cd4d3e94789a5985fcfa77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6827afcdf1f3481882f808dc01908a4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:07.746849 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-10358a0f-e49f-4948-84b1-11b24f10231d tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] 10.222.0.64 "GET /compute/v2.1/servers/17f9fd89-e668-4d3d-8d85-e648189ba0c2" status: 200 len: 1576 microversion: 2.1 time: 0.446235 Jul 19 15:51:07.747688 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 375/804] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:51:07 2022] GET /compute/v2.1/servers/17f9fd89-e668-4d3d-8d85-e648189ba0c2 => generated 1576 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:51:07.802252 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-e592a875-2696-4fcc-a7a5-cc40b248fda1 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Action: 'create', calling method: .version_select at 0x7fb8a5a04b80>, body: {"keypair": {"name": "tempest-keypair-1356458409", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKqT5TOYm0GyTBIhidQGEcOGst6RlsKy1YZ7oqirhJJP051pZCj9ScC8m5fWu8wzjqZN0CXj13U4c2EBBnHsUg3MwULO40H4o/3CUkylIRMPzrGa1Z5FWO3LUfPt0mz1qQ=="}} {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:51:07.823309 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.quota [None req-e592a875-2696-4fcc-a7a5-cc40b248fda1 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Getting quotas for project 45a72d232f314a78b0e1c3f04b0ed682. Resources: {'key_pairs'} {{(pid=129520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 15:51:07.831753 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.quota [None req-e592a875-2696-4fcc-a7a5-cc40b248fda1 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Getting quotas for user 2d7c42cf0bc84292bb0b7edb9f2e7fc3 and project 45a72d232f314a78b0e1c3f04b0ed682. Resources: {'key_pairs'} {{(pid=129520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 15:51:07.896884 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-e592a875-2696-4fcc-a7a5-cc40b248fda1 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.106174 Jul 19 15:51:07.898698 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 430/805] 10.222.0.64 () {60 vars in 1158 bytes} [Tue Jul 19 15:51:07 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:51:08.315332 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-6df5ca7c-ea71-46f4-ad5b-6f0981f724c7 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:08.316324 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-6df5ca7c-ea71-46f4-ad5b-6f0981f724c7 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 95bf808e-8c6d-4702-b942-027288ec604a] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:08.331299 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-6df5ca7c-ea71-46f4-ad5b-6f0981f724c7 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:08.333231 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-6df5ca7c-ea71-46f4-ad5b-6f0981f724c7 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:08.336251 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-6df5ca7c-ea71-46f4-ad5b-6f0981f724c7 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:08.337403 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-6df5ca7c-ea71-46f4-ad5b-6f0981f724c7 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:08.396911 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG dbcounter [-] [129519] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:51:08.464342 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-f9300076-bd95-4fb4-98c0-1ed367030e87 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:08.466052 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-f9300076-bd95-4fb4-98c0-1ed367030e87 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: df3309b1-ba0f-4f40-937f-fc95c9c8f6a0] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:08.490597 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-f9300076-bd95-4fb4-98c0-1ed367030e87 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:08.491437 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-f9300076-bd95-4fb4-98c0-1ed367030e87 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:08.492827 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-f9300076-bd95-4fb4-98c0-1ed367030e87 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:08.493537 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-f9300076-bd95-4fb4-98c0-1ed367030e87 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:08.889384 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-f9300076-bd95-4fb4-98c0-1ed367030e87 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:08.898528 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-f9300076-bd95-4fb4-98c0-1ed367030e87 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:08.900099 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-f9300076-bd95-4fb4-98c0-1ed367030e87 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:08.914989 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-f9300076-bd95-4fb4-98c0-1ed367030e87 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0" status: 200 len: 1741 microversion: 2.20 time: 0.446126 Jul 19 15:51:08.932800 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 431/806] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:51:08 2022] GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0 => generated 1741 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:51:08.941724 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-718661dc-4de4-4dc9-886f-797526ddf7c7 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:08.953881 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-718661dc-4de4-4dc9-886f-797526ddf7c7 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] [instance: 17f9fd89-e668-4d3d-8d85-e648189ba0c2] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:08.972527 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-718661dc-4de4-4dc9-886f-797526ddf7c7 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:08.975054 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-718661dc-4de4-4dc9-886f-797526ddf7c7 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:08.976637 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-718661dc-4de4-4dc9-886f-797526ddf7c7 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:08.977555 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-718661dc-4de4-4dc9-886f-797526ddf7c7 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:09.115547 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-718661dc-4de4-4dc9-886f-797526ddf7c7 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae334c4d93cd4d3e94789a5985fcfa77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6827afcdf1f3481882f808dc01908a4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:09.123396 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-718661dc-4de4-4dc9-886f-797526ddf7c7 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] 10.222.0.64 "GET /compute/v2.1/servers/17f9fd89-e668-4d3d-8d85-e648189ba0c2" status: 200 len: 1508 microversion: 2.1 time: 0.189095 Jul 19 15:51:09.123970 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 432/807] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:51:08 2022] GET /compute/v2.1/servers/17f9fd89-e668-4d3d-8d85-e648189ba0c2 => generated 1508 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:51:09.155346 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-6df5ca7c-ea71-46f4-ad5b-6f0981f724c7 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c75043813844d79fd0764132dfe4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e234f713b40cd8772372c2316dd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:09.166345 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-6df5ca7c-ea71-46f4-ad5b-6f0981f724c7 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "GET /compute/v2.1/servers/95bf808e-8c6d-4702-b942-027288ec604a" status: 200 len: 1549 microversion: 2.1 time: 0.857598 Jul 19 15:51:09.173395 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 376/808] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:51:08 2022] GET /compute/v2.1/servers/95bf808e-8c6d-4702-b942-027288ec604a => generated 1549 bytes in 867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:51:09.193527 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-481228d5-a7c5-4420-b0a0-5df948203a22 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:09.193894 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-481228d5-a7c5-4420-b0a0-5df948203a22 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 95bf808e-8c6d-4702-b942-027288ec604a] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:09.201055 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-481228d5-a7c5-4420-b0a0-5df948203a22 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:09.207146 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-481228d5-a7c5-4420-b0a0-5df948203a22 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:09.208079 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-481228d5-a7c5-4420-b0a0-5df948203a22 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:09.208415 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-481228d5-a7c5-4420-b0a0-5df948203a22 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:09.226400 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [req-a8015fae-2ccc-453a-84be-87a32258e2c7 req-d0815c04-113a-4acc-abad-0d2d41793800 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17f9fd89-e668-4d3d-8d85-e648189ba0c2", "name": "network-vif-deleted", "tag": "e3f80a5b-6ebe-4e28-8cb3-bd8fbe84b1e6"}]} {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:51:09.246623 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [req-a8015fae-2ccc-453a-84be-87a32258e2c7 req-d0815c04-113a-4acc-abad-0d2d41793800 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:09.249233 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [req-a8015fae-2ccc-453a-84be-87a32258e2c7 req-d0815c04-113a-4acc-abad-0d2d41793800 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:09.279914 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.compute.server_external_events [req-a8015fae-2ccc-453a-84be-87a32258e2c7 req-d0815c04-113a-4acc-abad-0d2d41793800 service nova] Creating event network-vif-deleted:e3f80a5b-6ebe-4e28-8cb3-bd8fbe84b1e6 for instance 17f9fd89-e668-4d3d-8d85-e648189ba0c2 on hv-cinder-84902 Jul 19 15:51:09.291823 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [req-a8015fae-2ccc-453a-84be-87a32258e2c7 req-d0815c04-113a-4acc-abad-0d2d41793800 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079692 Jul 19 15:51:09.299267 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-481228d5-a7c5-4420-b0a0-5df948203a22 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "GET /compute/v2.1/servers/95bf808e-8c6d-4702-b942-027288ec604a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.109798 Jul 19 15:51:09.300593 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 433/810] 10.222.0.64 () {58 vars in 1274 bytes} [Tue Jul 19 15:51:09 2022] GET /compute/v2.1/servers/95bf808e-8c6d-4702-b942-027288ec604a/os-interface => generated 285 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:51:09.300772 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 377/810] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Jul 19 15:51:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 15:51:09.939931 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-e3a18458-29c4-496d-93d9-6351bec0b73f tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:09.940485 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-e3a18458-29c4-496d-93d9-6351bec0b73f tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: df3309b1-ba0f-4f40-937f-fc95c9c8f6a0] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:09.955144 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-e3a18458-29c4-496d-93d9-6351bec0b73f tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:09.959939 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-e3a18458-29c4-496d-93d9-6351bec0b73f tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:09.960783 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-e3a18458-29c4-496d-93d9-6351bec0b73f tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:09.961224 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-e3a18458-29c4-496d-93d9-6351bec0b73f tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:10.142569 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-2b127bf6-7177-4b9a-bba2-271bca1b8124 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:10.143595 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-2b127bf6-7177-4b9a-bba2-271bca1b8124 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] [instance: 17f9fd89-e668-4d3d-8d85-e648189ba0c2] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:10.156674 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-2b127bf6-7177-4b9a-bba2-271bca1b8124 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:10.158271 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-2b127bf6-7177-4b9a-bba2-271bca1b8124 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:10.165811 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-2b127bf6-7177-4b9a-bba2-271bca1b8124 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:10.167560 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-2b127bf6-7177-4b9a-bba2-271bca1b8124 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:10.190223 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.wsgi [None req-2b127bf6-7177-4b9a-bba2-271bca1b8124 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] HTTP exception thrown: Instance 17f9fd89-e668-4d3d-8d85-e648189ba0c2 could not be found. Jul 19 15:51:10.192074 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-2b127bf6-7177-4b9a-bba2-271bca1b8124 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Request method failure captured: Jul 19 15:51:10.192074 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: request: GET /compute/v2.1/servers/17f9fd89-e668-4d3d-8d85-e648189ba0c2 HTTP/1.1 Jul 19 15:51:10.192074 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Accept: application/json Jul 19 15:51:10.192074 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Accept-Encoding: identity Jul 19 15:51:10.192074 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Connection: close Jul 19 15:51:10.192074 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Content-Length: 0 Jul 19 15:51:10.192074 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Content-Type: application/json Jul 19 15:51:10.192074 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Host: 10.222.0.64 Jul 19 15:51:10.192074 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Openstack-System-Scope: None Jul 19 15:51:10.192074 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: User-Agent: python-urllib3/1.26.9 Jul 19 15:51:10.192074 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Auth-Token: gAAAAABi1tIKmGNKjwQgkw9F_DlegiMzZqtLsl76NPyy0vJQFYgomcM9bzzZELZ_B5F1MJo9XaGabhaizyJFkZqqGK3-DLol0-LA7zgantfqN4gEYaL9Hb74O0C0Egru9kBMuLlaahTktA4ieEsVNRriI3odZ_vPLqGBzvwdDfERnmH70nsEmR0 Jul 19 15:51:10.192074 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Domain-Id: None Jul 19 15:51:10.192074 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Domain-Name: None Jul 19 15:51:10.192074 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Identity-Status: Confirmed Jul 19 15:51:10.192074 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Is-Admin-Project: True Jul 19 15:51:10.192074 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Domain-Id: default Jul 19 15:51:10.192074 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Domain-Name: Default Jul 19 15:51:10.192074 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Id: 6827afcdf1f3481882f808dc01908a4d Jul 19 15:51:10.192074 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Name: tempest-TestVolumeBootPattern-1663767670 Jul 19 15:51:10.192074 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Role: member,reader Jul 19 15:51:10.192074 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Roles: member,reader Jul 19 15:51:10.193403 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_6827afcdf1f3481882f808dc01908a4d", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6827afcdf1f3481882f808dc01908a4d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6827afcdf1f3481882f808dc01908a4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/6827afcdf1f3481882f808dc01908a4d"}]}] Jul 19 15:51:10.193403 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Tenant: tempest-TestVolumeBootPattern-1663767670 Jul 19 15:51:10.193403 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Tenant-Id: 6827afcdf1f3481882f808dc01908a4d Jul 19 15:51:10.193403 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Tenant-Name: tempest-TestVolumeBootPattern-1663767670 Jul 19 15:51:10.193403 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User: tempest-TestVolumeBootPattern-1663767670-project Jul 19 15:51:10.193403 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Domain-Id: default Jul 19 15:51:10.193403 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Domain-Name: Default Jul 19 15:51:10.193403 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Id: ae334c4d93cd4d3e94789a5985fcfa77 Jul 19 15:51:10.193403 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Name: tempest-TestVolumeBootPattern-1663767670-project Jul 19 15:51:10.193403 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: method: > Jul 19 15:51:10.193403 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: exception: Instance 17f9fd89-e668-4d3d-8d85-e648189ba0c2 could not be found. Jul 19 15:51:10.193403 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: action_args: {'id': '17f9fd89-e668-4d3d-8d85-e648189ba0c2'} Jul 19 15:51:10.194178 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:51:10.194178 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:51:10.194178 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 15:51:10.194178 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 15:51:10.194178 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 15:51:10.194178 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 15:51:10.194178 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 15:51:10.194178 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 15:51:10.194178 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 15:51:10.194178 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 15:51:10.194178 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17f9fd89-e668-4d3d-8d85-e648189ba0c2 could not be found. Jul 19 15:51:10.194178 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:51:10.194178 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:51:10.194178 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:51:10.194178 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:51:10.194178 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:51:10.194178 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:51:10.194178 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:51:10.194178 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:51:10.194178 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:51:10.195371 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:51:10.195371 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 15:51:10.195371 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 15:51:10.195371 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 15:51:10.195371 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 15:51:10.195371 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 15:51:10.195371 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 15:51:10.195371 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17f9fd89-e668-4d3d-8d85-e648189ba0c2 could not be found. Jul 19 15:51:10.195371 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:51:10.195371 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:51:10.195371 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:51:10.195371 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:51:10.195371 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:51:10.195371 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:51:10.195371 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:51:10.195371 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:51:10.195371 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17f9fd89-e668-4d3d-8d85-e648189ba0c2 could not be found. Jul 19 15:51:10.195371 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:51:10.198224 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-2b127bf6-7177-4b9a-bba2-271bca1b8124 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Returning 404 to user: Instance 17f9fd89-e668-4d3d-8d85-e648189ba0c2 could not be found. {{(pid=129519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:51:10.199602 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-2b127bf6-7177-4b9a-bba2-271bca1b8124 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] 10.222.0.64 "GET /compute/v2.1/servers/17f9fd89-e668-4d3d-8d85-e648189ba0c2" status: 404 len: 111 microversion: 2.1 time: 0.062301 Jul 19 15:51:10.200763 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 378/811] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:51:10 2022] GET /compute/v2.1/servers/17f9fd89-e668-4d3d-8d85-e648189ba0c2 => generated 111 bytes in 64 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 15:51:10.427482 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-edcfb6c4-c48f-42ba-98e9-04cb7f1ce306 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-425732722", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-701832674", "security_groups": [{"name": "tempest-secgroup-smoke-1743401924"}], "block_device_mapping_v2": [{"uuid": "9455a5c0-ff22-42f9-8391-abf6a43dbbad", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "195064b7-2168-479c-96ce-505c1a5c25ea"}]}} {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:51:10.534306 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-e3a18458-29c4-496d-93d9-6351bec0b73f tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:10.552370 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-e3a18458-29c4-496d-93d9-6351bec0b73f tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:10.554074 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-e3a18458-29c4-496d-93d9-6351bec0b73f tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:10.557722 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-e3a18458-29c4-496d-93d9-6351bec0b73f tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0" status: 200 len: 1741 microversion: 2.20 time: 0.623999 Jul 19 15:51:10.560938 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 434/812] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:51:09 2022] GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0 => generated 1741 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:51:10.756754 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.network.neutron [None req-edcfb6c4-c48f-42ba-98e9-04cb7f1ce306 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] validate_networks() for [('195064b7-2168-479c-96ce-505c1a5c25ea', None, None, None, None, None)] {{(pid=129519) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 15:51:11.579733 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-9dfef9aa-55a0-40c1-8a81-28dc25a2ae74 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:11.584970 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-9dfef9aa-55a0-40c1-8a81-28dc25a2ae74 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: df3309b1-ba0f-4f40-937f-fc95c9c8f6a0] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:11.599362 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-9dfef9aa-55a0-40c1-8a81-28dc25a2ae74 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:11.600211 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-9dfef9aa-55a0-40c1-8a81-28dc25a2ae74 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:11.601145 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-9dfef9aa-55a0-40c1-8a81-28dc25a2ae74 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:11.602254 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-9dfef9aa-55a0-40c1-8a81-28dc25a2ae74 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:11.605010 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.virt.hardware [None req-edcfb6c4-c48f-42ba-98e9-04cb7f1ce306 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Flavor limits 0:0:0 {{(pid=129519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 15:51:11.607171 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.virt.hardware [None req-edcfb6c4-c48f-42ba-98e9-04cb7f1ce306 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Image limits 0:0:0 {{(pid=129519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 15:51:11.607900 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.virt.hardware [None req-edcfb6c4-c48f-42ba-98e9-04cb7f1ce306 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Flavor pref 0:0:0 {{(pid=129519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 15:51:11.608537 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.virt.hardware [None req-edcfb6c4-c48f-42ba-98e9-04cb7f1ce306 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Image pref 0:0:0 {{(pid=129519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 15:51:11.610104 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.virt.hardware [None req-edcfb6c4-c48f-42ba-98e9-04cb7f1ce306 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 15:51:11.621429 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-edcfb6c4-c48f-42ba-98e9-04cb7f1ce306 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:11.622141 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-edcfb6c4-c48f-42ba-98e9-04cb7f1ce306 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:11.634672 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG dbcounter [-] [129520] Writing DB stats nova_cell1:SELECT=100 {{(pid=129520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:51:11.645986 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-edcfb6c4-c48f-42ba-98e9-04cb7f1ce306 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:11.647956 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-edcfb6c4-c48f-42ba-98e9-04cb7f1ce306 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:11.692909 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.quota [None req-edcfb6c4-c48f-42ba-98e9-04cb7f1ce306 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Getting quotas for project 6827afcdf1f3481882f808dc01908a4d. Resources: {'ram', 'instances', 'cores'} {{(pid=129519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 15:51:11.697695 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.quota [None req-edcfb6c4-c48f-42ba-98e9-04cb7f1ce306 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Getting quotas for user ae334c4d93cd4d3e94789a5985fcfa77 and project 6827afcdf1f3481882f808dc01908a4d. Resources: {'ram', 'instances', 'cores'} {{(pid=129519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 15:51:11.862005 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-9dfef9aa-55a0-40c1-8a81-28dc25a2ae74 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:11.865525 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-edcfb6c4-c48f-42ba-98e9-04cb7f1ce306 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Going to run 1 instances... {{(pid=129519) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 15:51:11.867777 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-edcfb6c4-c48f-42ba-98e9-04cb7f1ce306 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] [instance: d978b05a-906b-47db-8f20-9a7daaaf67f1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='9455a5c0-ff22-42f9-8391-abf6a43dbbad',volume_size=None,volume_type=None)] {{(pid=129519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 15:51:11.885416 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-9dfef9aa-55a0-40c1-8a81-28dc25a2ae74 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:11.890233 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-9dfef9aa-55a0-40c1-8a81-28dc25a2ae74 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:11.893770 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-9dfef9aa-55a0-40c1-8a81-28dc25a2ae74 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0" status: 200 len: 1741 microversion: 2.20 time: 0.317609 Jul 19 15:51:11.894775 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 435/813] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:51:11 2022] GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0 => generated 1741 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:51:11.901959 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-16668887-9d36-42bc-84c9-9f7839ba8087 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-749508534", "imageRef": "15012099-fe38-45ac-bd33-d884a5ba65f2", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fe8b95ad-7997-4bfd-893e-d87b2c843602"}], "security_groups": [{"name": "tempest-securitygroup--906665898"}], "key_name": "tempest-keypair-1356458409", "user_data": "}} {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:51:12.050443 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.network.neutron [None req-16668887-9d36-42bc-84c9-9f7839ba8087 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] validate_networks() for [('fe8b95ad-7997-4bfd-893e-d87b2c843602', None, None, None, None, None)] {{(pid=129520) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 15:51:12.128297 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-edcfb6c4-c48f-42ba-98e9-04cb7f1ce306 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.705281 Jul 19 15:51:12.135851 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 379/814] 10.222.0.64 () {60 vars in 1146 bytes} [Tue Jul 19 15:51:10 2022] POST /compute/v2.1/servers => generated 406 bytes in 1714 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 15:51:12.149957 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [req-bc810cca-a8f1-4516-8b68-228d1bf0e29c req-d3a92e73-5905-4a6c-9373-c757f142a29f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "95bf808e-8c6d-4702-b942-027288ec604a", "tag": "ebbcf9c9-0a61-4248-af0f-40d0e408b9f3"}]} {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:51:12.189951 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [req-bc810cca-a8f1-4516-8b68-228d1bf0e29c req-d3a92e73-5905-4a6c-9373-c757f142a29f service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:12.190463 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [req-bc810cca-a8f1-4516-8b68-228d1bf0e29c req-d3a92e73-5905-4a6c-9373-c757f142a29f service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:12.218306 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.compute.server_external_events [req-bc810cca-a8f1-4516-8b68-228d1bf0e29c req-d3a92e73-5905-4a6c-9373-c757f142a29f service nova] Creating event network-changed:ebbcf9c9-0a61-4248-af0f-40d0e408b9f3 for instance 95bf808e-8c6d-4702-b942-027288ec604a on hv-cinder-84902 Jul 19 15:51:12.235820 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [req-bc810cca-a8f1-4516-8b68-228d1bf0e29c req-d3a92e73-5905-4a6c-9373-c757f142a29f service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098173 Jul 19 15:51:12.239332 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 380/815] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Jul 19 15:51:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:51:12.248800 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-a0008b27-5800-4f6f-a1ab-9b27f8702f7f tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:12.249577 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-a0008b27-5800-4f6f-a1ab-9b27f8702f7f tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] [instance: d978b05a-906b-47db-8f20-9a7daaaf67f1] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:12.452067 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-a0008b27-5800-4f6f-a1ab-9b27f8702f7f tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae334c4d93cd4d3e94789a5985fcfa77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6827afcdf1f3481882f808dc01908a4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:12.461672 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-a0008b27-5800-4f6f-a1ab-9b27f8702f7f tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] 10.222.0.64 "GET /compute/v2.1/servers/d978b05a-906b-47db-8f20-9a7daaaf67f1" status: 200 len: 1093 microversion: 2.1 time: 0.221051 Jul 19 15:51:12.466723 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 381/816] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:51:12 2022] GET /compute/v2.1/servers/d978b05a-906b-47db-8f20-9a7daaaf67f1 => generated 1093 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:51:12.779464 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-64f7f9e3-275c-42fc-b39d-b99dbae4a173 tempest-VolumesGetTestJSON-803544507 tempest-VolumesGetTestJSON-803544507-project] Action: 'create', calling method: .version_select at 0x7fb8a5a98550>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-576621092", "metadata": {"Type": "work"}}} {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:51:13.138430 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.virt.hardware [None req-16668887-9d36-42bc-84c9-9f7839ba8087 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Flavor limits 0:0:0 {{(pid=129520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 15:51:13.139681 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.virt.hardware [None req-16668887-9d36-42bc-84c9-9f7839ba8087 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Image limits 0:0:0 {{(pid=129520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 15:51:13.140946 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.virt.hardware [None req-16668887-9d36-42bc-84c9-9f7839ba8087 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Flavor pref 0:0:0 {{(pid=129520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 15:51:13.141804 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.virt.hardware [None req-16668887-9d36-42bc-84c9-9f7839ba8087 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Image pref 0:0:0 {{(pid=129520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 15:51:13.142402 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.virt.hardware [None req-16668887-9d36-42bc-84c9-9f7839ba8087 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 15:51:13.166773 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-16668887-9d36-42bc-84c9-9f7839ba8087 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:13.169606 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-16668887-9d36-42bc-84c9-9f7839ba8087 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:13.173277 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-16668887-9d36-42bc-84c9-9f7839ba8087 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:13.173968 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-16668887-9d36-42bc-84c9-9f7839ba8087 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:13.248087 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.quota [None req-16668887-9d36-42bc-84c9-9f7839ba8087 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Getting quotas for project 45a72d232f314a78b0e1c3f04b0ed682. Resources: {'ram', 'instances', 'cores'} {{(pid=129520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 15:51:13.261446 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.quota [None req-16668887-9d36-42bc-84c9-9f7839ba8087 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Getting quotas for user 2d7c42cf0bc84292bb0b7edb9f2e7fc3 and project 45a72d232f314a78b0e1c3f04b0ed682. Resources: {'ram', 'instances', 'cores'} {{(pid=129520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 15:51:13.297039 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-16668887-9d36-42bc-84c9-9f7839ba8087 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Going to run 1 instances... {{(pid=129520) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 15:51:13.304770 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-16668887-9d36-42bc-84c9-9f7839ba8087 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: ef0f43ac-fd71-43ae-9213-9c3ab5f59161] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='15012099-fe38-45ac-bd33-d884a5ba65f2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 15:51:13.357945 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-64f7f9e3-275c-42fc-b39d-b99dbae4a173 tempest-VolumesGetTestJSON-803544507 tempest-VolumesGetTestJSON-803544507-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.802237 Jul 19 15:51:13.358954 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 382/817] 10.222.0.64 () {60 vars in 1155 bytes} [Tue Jul 19 15:51:12 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 804 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 19 15:51:13.373396 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-16668887-9d36-42bc-84c9-9f7839ba8087 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.476209 Jul 19 15:51:13.374147 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 436/818] 10.222.0.64 () {60 vars in 1146 bytes} [Tue Jul 19 15:51:11 2022] POST /compute/v2.1/servers => generated 401 bytes in 1478 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 15:51:13.380496 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-b8d5f93e-1b7e-42c8-8a8a-e3d4c5e13560 tempest-VolumesGetTestJSON-803544507 tempest-VolumesGetTestJSON-803544507-project] Calling method '.version_select at 0x7fb8a5a2d280>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:13.391431 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-c27d5447-9d99-4293-bb6c-7b892cf83047 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:13.392387 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-c27d5447-9d99-4293-bb6c-7b892cf83047 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: df3309b1-ba0f-4f40-937f-fc95c9c8f6a0] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:13.422083 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-c27d5447-9d99-4293-bb6c-7b892cf83047 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:13.422748 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-c27d5447-9d99-4293-bb6c-7b892cf83047 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:13.425495 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-c27d5447-9d99-4293-bb6c-7b892cf83047 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:13.428026 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-c27d5447-9d99-4293-bb6c-7b892cf83047 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:13.448416 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-b8d5f93e-1b7e-42c8-8a8a-e3d4c5e13560 tempest-VolumesGetTestJSON-803544507 tempest-VolumesGetTestJSON-803544507-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/09ff34be-42ed-4e61-8b43-1738d490de72" status: 200 len: 352 microversion: 2.1 time: 0.072543 Jul 19 15:51:13.449187 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 437/819] 10.222.0.64 () {58 vars in 1244 bytes} [Tue Jul 19 15:51:13 2022] GET /compute/v2.1/os-volumes/09ff34be-42ed-4e61-8b43-1738d490de72 => generated 352 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:51:13.465034 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-c824d12c-c498-44bb-9217-b214ba580a61 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:13.467767 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-c824d12c-c498-44bb-9217-b214ba580a61 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: ef0f43ac-fd71-43ae-9213-9c3ab5f59161] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:13.550484 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-c824d12c-c498-44bb-9217-b214ba580a61 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7c42cf0bc84292bb0b7edb9f2e7fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a72d232f314a78b0e1c3f04b0ed682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:13.561376 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-c824d12c-c498-44bb-9217-b214ba580a61 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/ef0f43ac-fd71-43ae-9213-9c3ab5f59161" status: 200 len: 1241 microversion: 2.1 time: 0.110917 Jul 19 15:51:13.563626 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 438/820] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:51:13 2022] GET /compute/v2.1/servers/ef0f43ac-fd71-43ae-9213-9c3ab5f59161 => generated 1241 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:51:13.569568 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-881bb9e4-82f2-4203-b845-f2a3a1251d51 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:13.570545 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-881bb9e4-82f2-4203-b845-f2a3a1251d51 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] [instance: d978b05a-906b-47db-8f20-9a7daaaf67f1] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:13.584822 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-881bb9e4-82f2-4203-b845-f2a3a1251d51 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:13.586079 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-881bb9e4-82f2-4203-b845-f2a3a1251d51 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:13.587324 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-881bb9e4-82f2-4203-b845-f2a3a1251d51 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:13.588185 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-881bb9e4-82f2-4203-b845-f2a3a1251d51 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:13.704460 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-881bb9e4-82f2-4203-b845-f2a3a1251d51 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae334c4d93cd4d3e94789a5985fcfa77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6827afcdf1f3481882f808dc01908a4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:13.714791 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-881bb9e4-82f2-4203-b845-f2a3a1251d51 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] 10.222.0.64 "GET /compute/v2.1/servers/d978b05a-906b-47db-8f20-9a7daaaf67f1" status: 200 len: 1191 microversion: 2.1 time: 0.147617 Jul 19 15:51:13.718134 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 439/821] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:51:13 2022] GET /compute/v2.1/servers/d978b05a-906b-47db-8f20-9a7daaaf67f1 => generated 1191 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:51:13.756523 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-c27d5447-9d99-4293-bb6c-7b892cf83047 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:13.793616 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-c27d5447-9d99-4293-bb6c-7b892cf83047 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:13.799698 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-c27d5447-9d99-4293-bb6c-7b892cf83047 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:13.805467 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-c27d5447-9d99-4293-bb6c-7b892cf83047 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0" status: 200 len: 1741 microversion: 2.20 time: 0.435807 Jul 19 15:51:13.805467 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 383/822] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:51:13 2022] GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0 => generated 1741 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:51:14.466285 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-ce7009e7-01d4-4acc-8740-c4f8a1186527 tempest-VolumesGetTestJSON-803544507 tempest-VolumesGetTestJSON-803544507-project] Calling method '.version_select at 0x7fb8a5a724c0>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:14.600016 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-ce7009e7-01d4-4acc-8740-c4f8a1186527 tempest-VolumesGetTestJSON-803544507 tempest-VolumesGetTestJSON-803544507-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/09ff34be-42ed-4e61-8b43-1738d490de72" status: 200 len: 353 microversion: 2.1 time: 0.138451 Jul 19 15:51:14.601032 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 440/823] 10.222.0.64 () {58 vars in 1244 bytes} [Tue Jul 19 15:51:14 2022] GET /compute/v2.1/os-volumes/09ff34be-42ed-4e61-8b43-1738d490de72 => generated 353 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 15:51:14.615205 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-0f1c1a4d-9ee2-4a30-9235-637be6c7ea97 tempest-VolumesGetTestJSON-803544507 tempest-VolumesGetTestJSON-803544507-project] Calling method '.version_select at 0x7fb8a5a2d040>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:14.616472 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-ee2dd5c1-573d-46bc-9738-ac3d5db5328a tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:14.617430 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-ee2dd5c1-573d-46bc-9738-ac3d5db5328a tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: ef0f43ac-fd71-43ae-9213-9c3ab5f59161] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:14.648531 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-ee2dd5c1-573d-46bc-9738-ac3d5db5328a tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:14.649159 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-ee2dd5c1-573d-46bc-9738-ac3d5db5328a tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:14.650063 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-ee2dd5c1-573d-46bc-9738-ac3d5db5328a tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:14.651259 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-ee2dd5c1-573d-46bc-9738-ac3d5db5328a tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:14.690883 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-0f1c1a4d-9ee2-4a30-9235-637be6c7ea97 tempest-VolumesGetTestJSON-803544507 tempest-VolumesGetTestJSON-803544507-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/09ff34be-42ed-4e61-8b43-1738d490de72" status: 200 len: 353 microversion: 2.1 time: 0.081891 Jul 19 15:51:14.692379 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 441/824] 10.222.0.64 () {58 vars in 1244 bytes} [Tue Jul 19 15:51:14 2022] GET /compute/v2.1/os-volumes/09ff34be-42ed-4e61-8b43-1738d490de72 => generated 353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:51:14.710477 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-6ce42baf-35f4-4604-b80c-15a61b5829a8 tempest-VolumesGetTestJSON-803544507 tempest-VolumesGetTestJSON-803544507-project] Calling method '.version_select at 0x7fb8a5a0f0d0>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:14.747663 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-ee2dd5c1-573d-46bc-9738-ac3d5db5328a tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7c42cf0bc84292bb0b7edb9f2e7fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a72d232f314a78b0e1c3f04b0ed682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:14.757622 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-ee2dd5c1-573d-46bc-9738-ac3d5db5328a tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/ef0f43ac-fd71-43ae-9213-9c3ab5f59161" status: 200 len: 1237 microversion: 2.1 time: 0.177499 Jul 19 15:51:14.763223 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 384/825] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:51:14 2022] GET /compute/v2.1/servers/ef0f43ac-fd71-43ae-9213-9c3ab5f59161 => generated 1237 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:51:14.784580 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-f71cb87c-ecbd-44bb-9910-0b368cc8b7d6 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:14.787631 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-f71cb87c-ecbd-44bb-9910-0b368cc8b7d6 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] [instance: d978b05a-906b-47db-8f20-9a7daaaf67f1] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:14.803932 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-f71cb87c-ecbd-44bb-9910-0b368cc8b7d6 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:14.804686 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-f71cb87c-ecbd-44bb-9910-0b368cc8b7d6 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:14.805912 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-f71cb87c-ecbd-44bb-9910-0b368cc8b7d6 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:14.806635 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-f71cb87c-ecbd-44bb-9910-0b368cc8b7d6 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:14.831125 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-6ce42baf-35f4-4604-b80c-15a61b5829a8 tempest-VolumesGetTestJSON-803544507 tempest-VolumesGetTestJSON-803544507-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/09ff34be-42ed-4e61-8b43-1738d490de72" status: 202 len: 0 microversion: 2.1 time: 0.124476 Jul 19 15:51:14.834756 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 442/826] 10.222.0.64 () {58 vars in 1247 bytes} [Tue Jul 19 15:51:14 2022] DELETE /compute/v2.1/os-volumes/09ff34be-42ed-4e61-8b43-1738d490de72 => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 15:51:14.839949 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-15743a5c-f17f-4f03-ba0b-e083038569b5 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:14.841934 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-15743a5c-f17f-4f03-ba0b-e083038569b5 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: df3309b1-ba0f-4f40-937f-fc95c9c8f6a0] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:14.856161 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-15743a5c-f17f-4f03-ba0b-e083038569b5 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:14.857926 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-15743a5c-f17f-4f03-ba0b-e083038569b5 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:14.859823 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-15743a5c-f17f-4f03-ba0b-e083038569b5 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:14.860454 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-15743a5c-f17f-4f03-ba0b-e083038569b5 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:15.005287 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-f71cb87c-ecbd-44bb-9910-0b368cc8b7d6 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae334c4d93cd4d3e94789a5985fcfa77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6827afcdf1f3481882f808dc01908a4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:15.024942 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-f71cb87c-ecbd-44bb-9910-0b368cc8b7d6 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] 10.222.0.64 "GET /compute/v2.1/servers/d978b05a-906b-47db-8f20-9a7daaaf67f1" status: 200 len: 1277 microversion: 2.1 time: 0.260234 Jul 19 15:51:15.026780 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 385/827] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:51:14 2022] GET /compute/v2.1/servers/d978b05a-906b-47db-8f20-9a7daaaf67f1 => generated 1277 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:51:15.035115 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-e9ca3f42-dcee-45aa-b19a-9f6ff73efb20 tempest-VolumesGetTestJSON-803544507 tempest-VolumesGetTestJSON-803544507-project] Calling method '.version_select at 0x7fb8a5a0f160>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:15.093642 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.wsgi [None req-e9ca3f42-dcee-45aa-b19a-9f6ff73efb20 tempest-VolumesGetTestJSON-803544507 tempest-VolumesGetTestJSON-803544507-project] HTTP exception thrown: Volume 09ff34be-42ed-4e61-8b43-1738d490de72 could not be found. Jul 19 15:51:15.096673 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-e9ca3f42-dcee-45aa-b19a-9f6ff73efb20 tempest-VolumesGetTestJSON-803544507 tempest-VolumesGetTestJSON-803544507-project] Request method failure captured: Jul 19 15:51:15.096673 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: request: GET /compute/v2.1/os-volumes/09ff34be-42ed-4e61-8b43-1738d490de72 HTTP/1.1 Jul 19 15:51:15.096673 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Accept: application/json Jul 19 15:51:15.096673 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Accept-Encoding: identity Jul 19 15:51:15.096673 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Connection: close Jul 19 15:51:15.096673 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Content-Length: 0 Jul 19 15:51:15.096673 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Content-Type: application/json Jul 19 15:51:15.096673 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Host: 10.222.0.64 Jul 19 15:51:15.096673 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Openstack-System-Scope: None Jul 19 15:51:15.096673 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: User-Agent: python-urllib3/1.26.9 Jul 19 15:51:15.096673 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Auth-Token: gAAAAABi1tLwyN72580RdtTGA1KScK8zN3fCDpZHCEJ2zXHFo7KBSxcaNltIcDEmsZMP22H2Smgv8rqXbAZIJNjsYSz2Bq5ugs5egsiY9kQSfhpIYL7sf9yemDcDFHTKu4BquIiGtnf1CNG1aXcc94oVNWgEpuHKLTdfqTPfaHH_LyG6qGkf4Gw Jul 19 15:51:15.096673 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Domain-Id: None Jul 19 15:51:15.096673 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Domain-Name: None Jul 19 15:51:15.096673 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Identity-Status: Confirmed Jul 19 15:51:15.096673 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Is-Admin-Project: True Jul 19 15:51:15.096673 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Domain-Id: default Jul 19 15:51:15.096673 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Domain-Name: Default Jul 19 15:51:15.096673 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Id: afc6b4c487d8495c893fa0f80d8fa4a2 Jul 19 15:51:15.096673 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Name: tempest-VolumesGetTestJSON-803544507 Jul 19 15:51:15.096673 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Role: member,reader Jul 19 15:51:15.096673 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Roles: member,reader Jul 19 15:51:15.098099 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_afc6b4c487d8495c893fa0f80d8fa4a2", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/afc6b4c487d8495c893fa0f80d8fa4a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/afc6b4c487d8495c893fa0f80d8fa4a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/afc6b4c487d8495c893fa0f80d8fa4a2"}]}] Jul 19 15:51:15.098099 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Tenant: tempest-VolumesGetTestJSON-803544507 Jul 19 15:51:15.098099 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Tenant-Id: afc6b4c487d8495c893fa0f80d8fa4a2 Jul 19 15:51:15.098099 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Tenant-Name: tempest-VolumesGetTestJSON-803544507 Jul 19 15:51:15.098099 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User: tempest-VolumesGetTestJSON-803544507-project Jul 19 15:51:15.098099 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Domain-Id: default Jul 19 15:51:15.098099 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Domain-Name: Default Jul 19 15:51:15.098099 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Id: 11ebed317b0f45d9af3599153809ff86 Jul 19 15:51:15.098099 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Name: tempest-VolumesGetTestJSON-803544507-project Jul 19 15:51:15.098099 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: method: Jul 19 15:51:15.098099 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: exception: Volume 09ff34be-42ed-4e61-8b43-1738d490de72 could not be found. Jul 19 15:51:15.098099 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: action_args: {'id': '09ff34be-42ed-4e61-8b43-1738d490de72'} Jul 19 15:51:15.098099 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:51:15.098998 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:51:15.098998 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 15:51:15.098998 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 15:51:15.098998 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 19 15:51:15.098998 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 19 15:51:15.098998 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 19 15:51:15.098998 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 19 15:51:15.098998 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 19 15:51:15.098998 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 19 15:51:15.098998 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 19 15:51:15.098998 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 19 15:51:15.098998 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 15:51:15.098998 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 15:51:15.098998 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 15:51:15.098998 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 15:51:15.098998 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 09ff34be-42ed-4e61-8b43-1738d490de72 could not be found. (HTTP 404) (Request-ID: req-2b1129a4-837b-4e0c-bfed-b6ffd5c5d2fc) Jul 19 15:51:15.098998 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:51:15.098998 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:51:15.098998 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:51:15.100302 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:51:15.100302 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 19 15:51:15.100302 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 19 15:51:15.100302 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 19 15:51:15.100302 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 19 15:51:15.100302 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 19 15:51:15.100302 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 19 15:51:15.100302 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 19 15:51:15.100302 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 19 15:51:15.100302 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 15:51:15.100302 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 15:51:15.100302 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 19 15:51:15.100302 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 19 15:51:15.100302 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 19 15:51:15.100302 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 19 15:51:15.100302 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 19 15:51:15.100302 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 19 15:51:15.100302 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 19 15:51:15.100302 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 19 15:51:15.101403 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 15:51:15.101403 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 15:51:15.101403 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 15:51:15.101403 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 15:51:15.101403 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 09ff34be-42ed-4e61-8b43-1738d490de72 could not be found. Jul 19 15:51:15.101403 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:51:15.101403 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:51:15.101403 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:51:15.101403 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:51:15.101403 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:51:15.101403 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:51:15.101403 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:51:15.101403 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:51:15.101403 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 15:51:15.101403 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 15:51:15.101403 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:51:15.101403 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:51:15.101403 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 19 15:51:15.101403 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 15:51:15.102693 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 09ff34be-42ed-4e61-8b43-1738d490de72 could not be found. Jul 19 15:51:15.102693 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:51:15.102693 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:51:15.102693 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:51:15.102693 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:51:15.102693 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:51:15.102693 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:51:15.102693 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:51:15.102693 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:51:15.102693 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 09ff34be-42ed-4e61-8b43-1738d490de72 could not be found. Jul 19 15:51:15.102693 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:51:15.104499 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-e9ca3f42-dcee-45aa-b19a-9f6ff73efb20 tempest-VolumesGetTestJSON-803544507 tempest-VolumesGetTestJSON-803544507-project] Returning 404 to user: Volume 09ff34be-42ed-4e61-8b43-1738d490de72 could not be found. {{(pid=129519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:51:15.105536 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-e9ca3f42-dcee-45aa-b19a-9f6ff73efb20 tempest-VolumesGetTestJSON-803544507 tempest-VolumesGetTestJSON-803544507-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/09ff34be-42ed-4e61-8b43-1738d490de72" status: 404 len: 109 microversion: 2.1 time: 0.077311 Jul 19 15:51:15.113154 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 386/828] 10.222.0.64 () {58 vars in 1244 bytes} [Tue Jul 19 15:51:15 2022] GET /compute/v2.1/os-volumes/09ff34be-42ed-4e61-8b43-1738d490de72 => generated 109 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 15:51:15.175871 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-15743a5c-f17f-4f03-ba0b-e083038569b5 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:15.185299 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-15743a5c-f17f-4f03-ba0b-e083038569b5 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:15.208353 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-15743a5c-f17f-4f03-ba0b-e083038569b5 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:15.211415 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-15743a5c-f17f-4f03-ba0b-e083038569b5 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0" status: 200 len: 1741 microversion: 2.20 time: 0.375388 Jul 19 15:51:15.214552 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 443/829] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:51:14 2022] GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0 => generated 1741 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:51:15.786074 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-d0a978a7-6386-45bf-a5e1-6ce4f0e583e5 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:15.790512 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-d0a978a7-6386-45bf-a5e1-6ce4f0e583e5 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: ef0f43ac-fd71-43ae-9213-9c3ab5f59161] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:15.816313 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-d0a978a7-6386-45bf-a5e1-6ce4f0e583e5 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:15.817013 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-d0a978a7-6386-45bf-a5e1-6ce4f0e583e5 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:15.817566 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-d0a978a7-6386-45bf-a5e1-6ce4f0e583e5 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:15.818008 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-d0a978a7-6386-45bf-a5e1-6ce4f0e583e5 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:16.002798 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-d0a978a7-6386-45bf-a5e1-6ce4f0e583e5 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7c42cf0bc84292bb0b7edb9f2e7fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a72d232f314a78b0e1c3f04b0ed682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:16.024042 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-d0a978a7-6386-45bf-a5e1-6ce4f0e583e5 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/ef0f43ac-fd71-43ae-9213-9c3ab5f59161" status: 200 len: 1299 microversion: 2.1 time: 0.250329 Jul 19 15:51:16.034735 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 387/830] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:51:15 2022] GET /compute/v2.1/servers/ef0f43ac-fd71-43ae-9213-9c3ab5f59161 => generated 1299 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:51:16.048469 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-349ffd03-cdf2-4bfd-8ca9-9bf478c39906 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:16.050333 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-349ffd03-cdf2-4bfd-8ca9-9bf478c39906 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] [instance: d978b05a-906b-47db-8f20-9a7daaaf67f1] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:16.063892 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-349ffd03-cdf2-4bfd-8ca9-9bf478c39906 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:16.064766 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-349ffd03-cdf2-4bfd-8ca9-9bf478c39906 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:16.066304 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-349ffd03-cdf2-4bfd-8ca9-9bf478c39906 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:16.067121 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-349ffd03-cdf2-4bfd-8ca9-9bf478c39906 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:16.231004 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [req-e037c28f-2334-4b34-8884-c0dc9d9748ee req-faa4660f-d66e-4796-9804-acb3efac33ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d978b05a-906b-47db-8f20-9a7daaaf67f1", "tag": "b12bd5cf-7ec9-4e31-91c4-9d3a0b5e7d26"}]} {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:51:16.258721 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [req-e037c28f-2334-4b34-8884-c0dc9d9748ee req-faa4660f-d66e-4796-9804-acb3efac33ad service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:16.260868 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [req-e037c28f-2334-4b34-8884-c0dc9d9748ee req-faa4660f-d66e-4796-9804-acb3efac33ad service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:16.283602 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.compute.server_external_events [req-e037c28f-2334-4b34-8884-c0dc9d9748ee req-faa4660f-d66e-4796-9804-acb3efac33ad service nova] Creating event network-changed:b12bd5cf-7ec9-4e31-91c4-9d3a0b5e7d26 for instance d978b05a-906b-47db-8f20-9a7daaaf67f1 on hv-cinder-84902 Jul 19 15:51:16.308376 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [req-e037c28f-2334-4b34-8884-c0dc9d9748ee req-faa4660f-d66e-4796-9804-acb3efac33ad service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074760 Jul 19 15:51:16.309893 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 388/831] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Jul 19 15:51:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:51:16.327109 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-004780cb-a2d7-47d8-af6a-fc1e1d7dcb22 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:16.329454 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-004780cb-a2d7-47d8-af6a-fc1e1d7dcb22 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: df3309b1-ba0f-4f40-937f-fc95c9c8f6a0] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:16.349107 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-004780cb-a2d7-47d8-af6a-fc1e1d7dcb22 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:16.350918 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-004780cb-a2d7-47d8-af6a-fc1e1d7dcb22 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:16.352569 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-004780cb-a2d7-47d8-af6a-fc1e1d7dcb22 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:16.353256 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-004780cb-a2d7-47d8-af6a-fc1e1d7dcb22 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:16.368905 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-349ffd03-cdf2-4bfd-8ca9-9bf478c39906 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae334c4d93cd4d3e94789a5985fcfa77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6827afcdf1f3481882f808dc01908a4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:16.377763 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-349ffd03-cdf2-4bfd-8ca9-9bf478c39906 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] 10.222.0.64 "GET /compute/v2.1/servers/d978b05a-906b-47db-8f20-9a7daaaf67f1" status: 200 len: 1265 microversion: 2.1 time: 0.336182 Jul 19 15:51:16.390576 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 444/832] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:51:16 2022] GET /compute/v2.1/servers/d978b05a-906b-47db-8f20-9a7daaaf67f1 => generated 1265 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:51:16.679284 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-004780cb-a2d7-47d8-af6a-fc1e1d7dcb22 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:16.696841 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-004780cb-a2d7-47d8-af6a-fc1e1d7dcb22 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:16.702073 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-004780cb-a2d7-47d8-af6a-fc1e1d7dcb22 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:16.705670 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-004780cb-a2d7-47d8-af6a-fc1e1d7dcb22 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0" status: 200 len: 1741 microversion: 2.20 time: 0.393665 Jul 19 15:51:16.708387 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 389/833] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:51:16 2022] GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0 => generated 1741 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:51:17.041856 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-18f3a237-9742-464f-bd26-0e23402a80b1 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:17.042547 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-18f3a237-9742-464f-bd26-0e23402a80b1 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: ef0f43ac-fd71-43ae-9213-9c3ab5f59161] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:17.061353 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-18f3a237-9742-464f-bd26-0e23402a80b1 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:17.061884 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-18f3a237-9742-464f-bd26-0e23402a80b1 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:17.063148 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-18f3a237-9742-464f-bd26-0e23402a80b1 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:17.063602 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-18f3a237-9742-464f-bd26-0e23402a80b1 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:17.310823 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-18f3a237-9742-464f-bd26-0e23402a80b1 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7c42cf0bc84292bb0b7edb9f2e7fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a72d232f314a78b0e1c3f04b0ed682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:17.320050 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-18f3a237-9742-464f-bd26-0e23402a80b1 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/ef0f43ac-fd71-43ae-9213-9c3ab5f59161" status: 200 len: 1366 microversion: 2.1 time: 0.282495 Jul 19 15:51:17.331222 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 445/834] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:51:17 2022] GET /compute/v2.1/servers/ef0f43ac-fd71-43ae-9213-9c3ab5f59161 => generated 1366 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:51:17.399781 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-51b4587c-1cc0-4de3-837f-1a79f1dad388 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:17.400524 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-51b4587c-1cc0-4de3-837f-1a79f1dad388 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] [instance: d978b05a-906b-47db-8f20-9a7daaaf67f1] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:17.413672 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-51b4587c-1cc0-4de3-837f-1a79f1dad388 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:17.416419 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-51b4587c-1cc0-4de3-837f-1a79f1dad388 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:17.419194 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-51b4587c-1cc0-4de3-837f-1a79f1dad388 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:17.420666 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-51b4587c-1cc0-4de3-837f-1a79f1dad388 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:17.725069 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-41adaff0-1281-418e-b870-8c70d7023103 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:17.725686 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-41adaff0-1281-418e-b870-8c70d7023103 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: df3309b1-ba0f-4f40-937f-fc95c9c8f6a0] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:17.739206 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-41adaff0-1281-418e-b870-8c70d7023103 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:17.739912 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-41adaff0-1281-418e-b870-8c70d7023103 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:17.740851 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-41adaff0-1281-418e-b870-8c70d7023103 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:17.749538 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-41adaff0-1281-418e-b870-8c70d7023103 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:17.771082 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-51b4587c-1cc0-4de3-837f-1a79f1dad388 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae334c4d93cd4d3e94789a5985fcfa77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6827afcdf1f3481882f808dc01908a4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:17.781202 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-51b4587c-1cc0-4de3-837f-1a79f1dad388 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] 10.222.0.64 "GET /compute/v2.1/servers/d978b05a-906b-47db-8f20-9a7daaaf67f1" status: 200 len: 1265 microversion: 2.1 time: 0.384516 Jul 19 15:51:17.782429 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 390/835] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:51:17 2022] GET /compute/v2.1/servers/d978b05a-906b-47db-8f20-9a7daaaf67f1 => generated 1265 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:51:18.029307 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-41adaff0-1281-418e-b870-8c70d7023103 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:18.042447 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-41adaff0-1281-418e-b870-8c70d7023103 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:18.047384 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-41adaff0-1281-418e-b870-8c70d7023103 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:18.053085 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-41adaff0-1281-418e-b870-8c70d7023103 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0" status: 200 len: 1741 microversion: 2.20 time: 0.331805 Jul 19 15:51:18.057086 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 446/836] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:51:17 2022] GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0 => generated 1741 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 15:51:18.337164 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-80bae2be-3940-4876-adad-1bb96f3a8001 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:18.337787 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-80bae2be-3940-4876-adad-1bb96f3a8001 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: ef0f43ac-fd71-43ae-9213-9c3ab5f59161] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:18.344487 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-80bae2be-3940-4876-adad-1bb96f3a8001 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:18.344944 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-80bae2be-3940-4876-adad-1bb96f3a8001 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:18.345726 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-80bae2be-3940-4876-adad-1bb96f3a8001 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:18.346170 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-80bae2be-3940-4876-adad-1bb96f3a8001 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:18.508522 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [req-1b9822bd-27b4-4120-b0e4-57ed0796725a req-40fededd-a34c-47f4-92a0-84affac666c4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef0f43ac-fd71-43ae-9213-9c3ab5f59161", "tag": "b5584b46-dc66-4b7c-8ae4-94dc57d1af3b"}]} {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:51:18.523594 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [req-1b9822bd-27b4-4120-b0e4-57ed0796725a req-40fededd-a34c-47f4-92a0-84affac666c4 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:18.524166 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [req-1b9822bd-27b4-4120-b0e4-57ed0796725a req-40fededd-a34c-47f4-92a0-84affac666c4 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:18.537866 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.compute.server_external_events [req-1b9822bd-27b4-4120-b0e4-57ed0796725a req-40fededd-a34c-47f4-92a0-84affac666c4 service nova] Creating event network-changed:b5584b46-dc66-4b7c-8ae4-94dc57d1af3b for instance ef0f43ac-fd71-43ae-9213-9c3ab5f59161 on hv-cinder-84902 Jul 19 15:51:18.546882 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [req-1b9822bd-27b4-4120-b0e4-57ed0796725a req-40fededd-a34c-47f4-92a0-84affac666c4 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047342 Jul 19 15:51:18.551172 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 447/837] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Jul 19 15:51:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:51:18.801461 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-ad0dd52a-cf17-4260-ba8d-c39bf94e970f tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:18.802306 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-ad0dd52a-cf17-4260-ba8d-c39bf94e970f tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] [instance: d978b05a-906b-47db-8f20-9a7daaaf67f1] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:18.803328 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-80bae2be-3940-4876-adad-1bb96f3a8001 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7c42cf0bc84292bb0b7edb9f2e7fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a72d232f314a78b0e1c3f04b0ed682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:18.819465 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-80bae2be-3940-4876-adad-1bb96f3a8001 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/ef0f43ac-fd71-43ae-9213-9c3ab5f59161" status: 200 len: 1366 microversion: 2.1 time: 0.486174 Jul 19 15:51:18.820228 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 391/838] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:51:18 2022] GET /compute/v2.1/servers/ef0f43ac-fd71-43ae-9213-9c3ab5f59161 => generated 1366 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:51:18.835066 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-ad0dd52a-cf17-4260-ba8d-c39bf94e970f tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:18.835897 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-ad0dd52a-cf17-4260-ba8d-c39bf94e970f tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:18.836931 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-ad0dd52a-cf17-4260-ba8d-c39bf94e970f tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:18.837593 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-ad0dd52a-cf17-4260-ba8d-c39bf94e970f tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:19.031730 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-ad0dd52a-cf17-4260-ba8d-c39bf94e970f tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae334c4d93cd4d3e94789a5985fcfa77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6827afcdf1f3481882f808dc01908a4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:19.043956 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-ad0dd52a-cf17-4260-ba8d-c39bf94e970f tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] 10.222.0.64 "GET /compute/v2.1/servers/d978b05a-906b-47db-8f20-9a7daaaf67f1" status: 200 len: 1265 microversion: 2.1 time: 0.248431 Jul 19 15:51:19.048465 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 448/839] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:51:18 2022] GET /compute/v2.1/servers/d978b05a-906b-47db-8f20-9a7daaaf67f1 => generated 1265 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:51:19.078121 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-3ec0f6f8-6142-4676-b282-f80406134a8d tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:19.079109 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-3ec0f6f8-6142-4676-b282-f80406134a8d tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: df3309b1-ba0f-4f40-937f-fc95c9c8f6a0] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:19.088444 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-3ec0f6f8-6142-4676-b282-f80406134a8d tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:19.098195 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-3ec0f6f8-6142-4676-b282-f80406134a8d tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:19.100589 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-3ec0f6f8-6142-4676-b282-f80406134a8d tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:19.101195 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-3ec0f6f8-6142-4676-b282-f80406134a8d tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:19.314123 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-3ec0f6f8-6142-4676-b282-f80406134a8d tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:19.324049 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-3ec0f6f8-6142-4676-b282-f80406134a8d tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:19.326988 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-3ec0f6f8-6142-4676-b282-f80406134a8d tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:19.328619 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-3ec0f6f8-6142-4676-b282-f80406134a8d tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0" status: 200 len: 1741 microversion: 2.20 time: 0.257050 Jul 19 15:51:19.329727 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 392/840] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:51:19 2022] GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0 => generated 1741 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:51:19.838879 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-1d11da9d-58f3-4cd2-8e43-f3f958ed2eb9 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:19.840092 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-1d11da9d-58f3-4cd2-8e43-f3f958ed2eb9 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: ef0f43ac-fd71-43ae-9213-9c3ab5f59161] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:19.850172 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-1d11da9d-58f3-4cd2-8e43-f3f958ed2eb9 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:19.852810 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-1d11da9d-58f3-4cd2-8e43-f3f958ed2eb9 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:19.852810 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-1d11da9d-58f3-4cd2-8e43-f3f958ed2eb9 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:19.852810 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-1d11da9d-58f3-4cd2-8e43-f3f958ed2eb9 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:20.001371 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-1d11da9d-58f3-4cd2-8e43-f3f958ed2eb9 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7c42cf0bc84292bb0b7edb9f2e7fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a72d232f314a78b0e1c3f04b0ed682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:20.012865 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-1d11da9d-58f3-4cd2-8e43-f3f958ed2eb9 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/ef0f43ac-fd71-43ae-9213-9c3ab5f59161" status: 200 len: 1366 microversion: 2.1 time: 0.179515 Jul 19 15:51:20.014107 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 449/841] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:51:19 2022] GET /compute/v2.1/servers/ef0f43ac-fd71-43ae-9213-9c3ab5f59161 => generated 1366 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:51:20.066809 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-7e6ae20c-418d-42a1-9ec8-098c9e6f1104 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:20.067596 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-7e6ae20c-418d-42a1-9ec8-098c9e6f1104 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] [instance: d978b05a-906b-47db-8f20-9a7daaaf67f1] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:20.078395 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-7e6ae20c-418d-42a1-9ec8-098c9e6f1104 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:20.090781 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-7e6ae20c-418d-42a1-9ec8-098c9e6f1104 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:20.091687 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-7e6ae20c-418d-42a1-9ec8-098c9e6f1104 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:20.092141 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-7e6ae20c-418d-42a1-9ec8-098c9e6f1104 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:20.352735 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-7e6ae20c-418d-42a1-9ec8-098c9e6f1104 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae334c4d93cd4d3e94789a5985fcfa77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6827afcdf1f3481882f808dc01908a4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:20.353334 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-37b6f075-3c3b-4688-beb6-d4c509a910ec tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:20.353980 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-37b6f075-3c3b-4688-beb6-d4c509a910ec tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: df3309b1-ba0f-4f40-937f-fc95c9c8f6a0] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:20.362463 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-7e6ae20c-418d-42a1-9ec8-098c9e6f1104 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] 10.222.0.64 "GET /compute/v2.1/servers/d978b05a-906b-47db-8f20-9a7daaaf67f1" status: 200 len: 1265 microversion: 2.1 time: 0.301444 Jul 19 15:51:20.363672 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-37b6f075-3c3b-4688-beb6-d4c509a910ec tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:20.364418 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-37b6f075-3c3b-4688-beb6-d4c509a910ec tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:20.365564 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-37b6f075-3c3b-4688-beb6-d4c509a910ec tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:20.366614 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-37b6f075-3c3b-4688-beb6-d4c509a910ec tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:20.372283 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 393/842] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:51:20 2022] GET /compute/v2.1/servers/d978b05a-906b-47db-8f20-9a7daaaf67f1 => generated 1265 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:51:20.821622 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-37b6f075-3c3b-4688-beb6-d4c509a910ec tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:20.835091 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-37b6f075-3c3b-4688-beb6-d4c509a910ec tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:20.841989 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-37b6f075-3c3b-4688-beb6-d4c509a910ec tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:20.847983 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-37b6f075-3c3b-4688-beb6-d4c509a910ec tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0" status: 200 len: 1741 microversion: 2.20 time: 0.502796 Jul 19 15:51:20.849247 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 450/843] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:51:20 2022] GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0 => generated 1741 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 15:51:21.031615 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-de4d0e21-7334-4be5-bf4c-c19609bc6174 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:21.033352 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-de4d0e21-7334-4be5-bf4c-c19609bc6174 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: ef0f43ac-fd71-43ae-9213-9c3ab5f59161] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:21.040380 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-de4d0e21-7334-4be5-bf4c-c19609bc6174 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:21.040832 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-de4d0e21-7334-4be5-bf4c-c19609bc6174 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:21.041887 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-de4d0e21-7334-4be5-bf4c-c19609bc6174 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:21.042329 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-de4d0e21-7334-4be5-bf4c-c19609bc6174 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:21.175469 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-de4d0e21-7334-4be5-bf4c-c19609bc6174 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7c42cf0bc84292bb0b7edb9f2e7fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a72d232f314a78b0e1c3f04b0ed682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:21.182927 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-de4d0e21-7334-4be5-bf4c-c19609bc6174 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/ef0f43ac-fd71-43ae-9213-9c3ab5f59161" status: 200 len: 1366 microversion: 2.1 time: 0.155863 Jul 19 15:51:21.183490 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 394/844] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:51:21 2022] GET /compute/v2.1/servers/ef0f43ac-fd71-43ae-9213-9c3ab5f59161 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:51:21.379366 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-a20910dc-2471-4468-85ea-45d597a31a89 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:21.380099 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-a20910dc-2471-4468-85ea-45d597a31a89 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] [instance: d978b05a-906b-47db-8f20-9a7daaaf67f1] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:21.387132 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-a20910dc-2471-4468-85ea-45d597a31a89 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:21.387691 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-a20910dc-2471-4468-85ea-45d597a31a89 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:21.388533 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-a20910dc-2471-4468-85ea-45d597a31a89 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:21.389009 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-a20910dc-2471-4468-85ea-45d597a31a89 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:21.537593 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-a20910dc-2471-4468-85ea-45d597a31a89 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae334c4d93cd4d3e94789a5985fcfa77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6827afcdf1f3481882f808dc01908a4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:21.547027 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-a20910dc-2471-4468-85ea-45d597a31a89 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] 10.222.0.64 "GET /compute/v2.1/servers/d978b05a-906b-47db-8f20-9a7daaaf67f1" status: 200 len: 1265 microversion: 2.1 time: 0.171192 Jul 19 15:51:21.547796 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 451/845] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:51:21 2022] GET /compute/v2.1/servers/d978b05a-906b-47db-8f20-9a7daaaf67f1 => generated 1265 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:51:21.866526 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-9f51340f-f7a5-421f-927a-fb0c94185689 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:21.867280 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-9f51340f-f7a5-421f-927a-fb0c94185689 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: df3309b1-ba0f-4f40-937f-fc95c9c8f6a0] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:21.869234 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG dbcounter [-] [129519] Writing DB stats nova_cell0:SELECT=2 {{(pid=129519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:51:21.870952 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG dbcounter [-] [129519] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=129519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:51:21.876401 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-9f51340f-f7a5-421f-927a-fb0c94185689 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:21.876401 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-9f51340f-f7a5-421f-927a-fb0c94185689 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:21.876951 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-9f51340f-f7a5-421f-927a-fb0c94185689 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:21.877377 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-9f51340f-f7a5-421f-927a-fb0c94185689 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:22.016497 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-9f51340f-f7a5-421f-927a-fb0c94185689 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:22.024800 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-9f51340f-f7a5-421f-927a-fb0c94185689 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:22.026315 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-9f51340f-f7a5-421f-927a-fb0c94185689 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:22.027472 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-9f51340f-f7a5-421f-927a-fb0c94185689 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0" status: 200 len: 1723 microversion: 2.20 time: 0.164891 Jul 19 15:51:22.028033 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 395/846] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:51:21 2022] GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0 => generated 1723 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:51:22.201367 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-6fdfd70e-730d-41b7-a6e2-eea5fd1ab5d5 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:22.201935 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-6fdfd70e-730d-41b7-a6e2-eea5fd1ab5d5 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: ef0f43ac-fd71-43ae-9213-9c3ab5f59161] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:22.209093 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-6fdfd70e-730d-41b7-a6e2-eea5fd1ab5d5 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:22.209490 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-6fdfd70e-730d-41b7-a6e2-eea5fd1ab5d5 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:22.210538 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-6fdfd70e-730d-41b7-a6e2-eea5fd1ab5d5 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:22.211040 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-6fdfd70e-730d-41b7-a6e2-eea5fd1ab5d5 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:22.352181 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-6fdfd70e-730d-41b7-a6e2-eea5fd1ab5d5 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7c42cf0bc84292bb0b7edb9f2e7fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a72d232f314a78b0e1c3f04b0ed682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:22.359661 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-6fdfd70e-730d-41b7-a6e2-eea5fd1ab5d5 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/ef0f43ac-fd71-43ae-9213-9c3ab5f59161" status: 200 len: 1366 microversion: 2.1 time: 0.162224 Jul 19 15:51:22.360249 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 452/847] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:51:22 2022] GET /compute/v2.1/servers/ef0f43ac-fd71-43ae-9213-9c3ab5f59161 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:51:22.564896 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-35d3f9ce-c41d-47b4-9d6b-7a0f378f7d02 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:22.565444 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-35d3f9ce-c41d-47b4-9d6b-7a0f378f7d02 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] [instance: d978b05a-906b-47db-8f20-9a7daaaf67f1] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:22.567791 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG dbcounter [-] [129519] Writing DB stats nova_cell0:SELECT=8 {{(pid=129519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:51:22.573289 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-35d3f9ce-c41d-47b4-9d6b-7a0f378f7d02 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:22.573734 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-35d3f9ce-c41d-47b4-9d6b-7a0f378f7d02 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:22.574521 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-35d3f9ce-c41d-47b4-9d6b-7a0f378f7d02 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:22.574954 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-35d3f9ce-c41d-47b4-9d6b-7a0f378f7d02 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:22.711445 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-35d3f9ce-c41d-47b4-9d6b-7a0f378f7d02 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae334c4d93cd4d3e94789a5985fcfa77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6827afcdf1f3481882f808dc01908a4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:22.718880 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-35d3f9ce-c41d-47b4-9d6b-7a0f378f7d02 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] 10.222.0.64 "GET /compute/v2.1/servers/d978b05a-906b-47db-8f20-9a7daaaf67f1" status: 200 len: 1265 microversion: 2.1 time: 0.158795 Jul 19 15:51:22.719446 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 396/848] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:51:22 2022] GET /compute/v2.1/servers/d978b05a-906b-47db-8f20-9a7daaaf67f1 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:51:23.047002 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-48eaefc2-5274-4dff-99ed-8d0c5a8f8837 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:23.047826 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-48eaefc2-5274-4dff-99ed-8d0c5a8f8837 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: df3309b1-ba0f-4f40-937f-fc95c9c8f6a0] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:23.054623 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-48eaefc2-5274-4dff-99ed-8d0c5a8f8837 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:23.055081 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-48eaefc2-5274-4dff-99ed-8d0c5a8f8837 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:23.055846 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-48eaefc2-5274-4dff-99ed-8d0c5a8f8837 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:23.056270 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-48eaefc2-5274-4dff-99ed-8d0c5a8f8837 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:23.193499 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-48eaefc2-5274-4dff-99ed-8d0c5a8f8837 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:23.203444 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-48eaefc2-5274-4dff-99ed-8d0c5a8f8837 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:23.204959 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-48eaefc2-5274-4dff-99ed-8d0c5a8f8837 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:23.206150 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-48eaefc2-5274-4dff-99ed-8d0c5a8f8837 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0" status: 200 len: 1723 microversion: 2.20 time: 0.163608 Jul 19 15:51:23.206735 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 453/849] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:51:23 2022] GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:51:23.376765 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-327c8603-0690-4a24-b3bd-364d44ad4175 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:23.377365 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-327c8603-0690-4a24-b3bd-364d44ad4175 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: ef0f43ac-fd71-43ae-9213-9c3ab5f59161] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:23.383608 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-327c8603-0690-4a24-b3bd-364d44ad4175 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:23.384068 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-327c8603-0690-4a24-b3bd-364d44ad4175 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:23.384913 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-327c8603-0690-4a24-b3bd-364d44ad4175 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:23.385390 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-327c8603-0690-4a24-b3bd-364d44ad4175 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:23.524810 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-327c8603-0690-4a24-b3bd-364d44ad4175 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7c42cf0bc84292bb0b7edb9f2e7fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a72d232f314a78b0e1c3f04b0ed682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:23.533304 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-327c8603-0690-4a24-b3bd-364d44ad4175 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/ef0f43ac-fd71-43ae-9213-9c3ab5f59161" status: 200 len: 1366 microversion: 2.1 time: 0.160586 Jul 19 15:51:23.534243 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 397/850] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:51:23 2022] GET /compute/v2.1/servers/ef0f43ac-fd71-43ae-9213-9c3ab5f59161 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:51:23.736337 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-db088b85-d2ad-4b8f-867d-9c931916cc27 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:23.736982 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-db088b85-d2ad-4b8f-867d-9c931916cc27 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] [instance: d978b05a-906b-47db-8f20-9a7daaaf67f1] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:23.739045 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG dbcounter [-] [129520] Writing DB stats nova_cell0:SELECT=2 {{(pid=129520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:51:23.739729 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG dbcounter [-] [129520] Writing DB stats nova_cell0:SELECT=12 {{(pid=129520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:51:23.745330 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-db088b85-d2ad-4b8f-867d-9c931916cc27 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:23.745765 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-db088b85-d2ad-4b8f-867d-9c931916cc27 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:23.746565 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-db088b85-d2ad-4b8f-867d-9c931916cc27 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:23.746994 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-db088b85-d2ad-4b8f-867d-9c931916cc27 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:23.884365 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-db088b85-d2ad-4b8f-867d-9c931916cc27 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae334c4d93cd4d3e94789a5985fcfa77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6827afcdf1f3481882f808dc01908a4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:23.892332 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-db088b85-d2ad-4b8f-867d-9c931916cc27 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] 10.222.0.64 "GET /compute/v2.1/servers/d978b05a-906b-47db-8f20-9a7daaaf67f1" status: 200 len: 1265 microversion: 2.1 time: 0.160408 Jul 19 15:51:23.892745 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 454/851] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:51:23 2022] GET /compute/v2.1/servers/d978b05a-906b-47db-8f20-9a7daaaf67f1 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:51:24.225399 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-6095020b-bc32-45e6-b453-f03a17131dc4 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:24.226038 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-6095020b-bc32-45e6-b453-f03a17131dc4 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: df3309b1-ba0f-4f40-937f-fc95c9c8f6a0] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:24.234714 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-6095020b-bc32-45e6-b453-f03a17131dc4 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:24.235195 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-6095020b-bc32-45e6-b453-f03a17131dc4 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:24.236325 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-6095020b-bc32-45e6-b453-f03a17131dc4 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:24.236772 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-6095020b-bc32-45e6-b453-f03a17131dc4 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:24.371289 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-6095020b-bc32-45e6-b453-f03a17131dc4 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:24.380358 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-6095020b-bc32-45e6-b453-f03a17131dc4 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:24.381848 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-6095020b-bc32-45e6-b453-f03a17131dc4 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:24.383014 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-6095020b-bc32-45e6-b453-f03a17131dc4 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0" status: 200 len: 1666 microversion: 2.20 time: 0.161606 Jul 19 15:51:24.383576 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 398/852] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:51:24 2022] GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0 => generated 1666 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:51:24.401510 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-b308b7ae-d921-4be8-a1ef-1d32c8f46243 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a733a2e5-9c12-4429-b305-f4a27ae1f2a1"}} {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:51:24.402727 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-b308b7ae-d921-4be8-a1ef-1d32c8f46243 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: df3309b1-ba0f-4f40-937f-fc95c9c8f6a0] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:24.410583 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b308b7ae-d921-4be8-a1ef-1d32c8f46243 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:24.411027 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b308b7ae-d921-4be8-a1ef-1d32c8f46243 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:24.411783 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b308b7ae-d921-4be8-a1ef-1d32c8f46243 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:24.412211 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b308b7ae-d921-4be8-a1ef-1d32c8f46243 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:24.551673 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-71a33ab1-4c9b-4851-9618-ab3ee9fd422f tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:24.552733 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-71a33ab1-4c9b-4851-9618-ab3ee9fd422f tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: ef0f43ac-fd71-43ae-9213-9c3ab5f59161] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:24.559467 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-71a33ab1-4c9b-4851-9618-ab3ee9fd422f tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:24.559980 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-71a33ab1-4c9b-4851-9618-ab3ee9fd422f tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:24.560985 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-71a33ab1-4c9b-4851-9618-ab3ee9fd422f tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:24.561594 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-71a33ab1-4c9b-4851-9618-ab3ee9fd422f tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:24.586862 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG dbcounter [-] [129519] Writing DB stats nova_cell1:SELECT=100 {{(pid=129519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:51:24.735965 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-71a33ab1-4c9b-4851-9618-ab3ee9fd422f tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7c42cf0bc84292bb0b7edb9f2e7fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a72d232f314a78b0e1c3f04b0ed682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:24.743971 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-71a33ab1-4c9b-4851-9618-ab3ee9fd422f tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/ef0f43ac-fd71-43ae-9213-9c3ab5f59161" status: 200 len: 1366 microversion: 2.1 time: 0.196382 Jul 19 15:51:24.751812 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG dbcounter [-] [129520] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=129520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:51:24.754470 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 399/853] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:51:24 2022] GET /compute/v2.1/servers/ef0f43ac-fd71-43ae-9213-9c3ab5f59161 => generated 1366 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:51:24.759957 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-b308b7ae-d921-4be8-a1ef-1d32c8f46243 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "POST /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.362400 Jul 19 15:51:24.760559 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 455/854] 10.222.0.64 () {62 vars in 1363 bytes} [Tue Jul 19 15:51:24 2022] POST /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0/os-volume_attachments => generated 188 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 19 15:51:24.816657 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [req-4b02740a-577a-44e4-b8a5-48a3c35f1408 req-a89b8784-fdd2-4670-9bef-86db79bdb4a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef0f43ac-fd71-43ae-9213-9c3ab5f59161", "name": "network-vif-plugged", "status": "completed", "tag": "b5584b46-dc66-4b7c-8ae4-94dc57d1af3b"}]} {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:51:24.829552 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [req-4b02740a-577a-44e4-b8a5-48a3c35f1408 req-a89b8784-fdd2-4670-9bef-86db79bdb4a2 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:24.831122 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [req-4b02740a-577a-44e4-b8a5-48a3c35f1408 req-a89b8784-fdd2-4670-9bef-86db79bdb4a2 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:24.852238 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.compute.server_external_events [req-4b02740a-577a-44e4-b8a5-48a3c35f1408 req-a89b8784-fdd2-4670-9bef-86db79bdb4a2 service nova] Creating event network-vif-plugged:b5584b46-dc66-4b7c-8ae4-94dc57d1af3b for instance ef0f43ac-fd71-43ae-9213-9c3ab5f59161 on hv-cinder-84902 Jul 19 15:51:24.860753 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [req-4b02740a-577a-44e4-b8a5-48a3c35f1408 req-a89b8784-fdd2-4670-9bef-86db79bdb4a2 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045875 Jul 19 15:51:24.862282 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 400/855] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Jul 19 15:51:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:51:24.923349 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-bef7705f-d039-4738-9310-234cf29ff944 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:24.923932 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-bef7705f-d039-4738-9310-234cf29ff944 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: df3309b1-ba0f-4f40-937f-fc95c9c8f6a0] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:24.927811 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-fce97963-f207-4253-8ac9-4e38f79d701d tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:24.928436 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-fce97963-f207-4253-8ac9-4e38f79d701d tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] [instance: d978b05a-906b-47db-8f20-9a7daaaf67f1] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:24.935807 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-fce97963-f207-4253-8ac9-4e38f79d701d tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:24.936491 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-fce97963-f207-4253-8ac9-4e38f79d701d tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:24.938264 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-fce97963-f207-4253-8ac9-4e38f79d701d tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:24.938889 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-fce97963-f207-4253-8ac9-4e38f79d701d tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:24.943247 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-bef7705f-d039-4738-9310-234cf29ff944 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:24.958861 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-bef7705f-d039-4738-9310-234cf29ff944 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:24.960535 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-bef7705f-d039-4738-9310-234cf29ff944 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:24.961010 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-bef7705f-d039-4738-9310-234cf29ff944 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:25.176081 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-fce97963-f207-4253-8ac9-4e38f79d701d tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae334c4d93cd4d3e94789a5985fcfa77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6827afcdf1f3481882f808dc01908a4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:25.185148 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-fce97963-f207-4253-8ac9-4e38f79d701d tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] 10.222.0.64 "GET /compute/v2.1/servers/d978b05a-906b-47db-8f20-9a7daaaf67f1" status: 200 len: 1265 microversion: 2.1 time: 0.272241 Jul 19 15:51:25.197043 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 456/856] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:51:24 2022] GET /compute/v2.1/servers/d978b05a-906b-47db-8f20-9a7daaaf67f1 => generated 1265 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:51:25.282816 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-bef7705f-d039-4738-9310-234cf29ff944 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "DELETE /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0/os-volume_attachments/a733a2e5-9c12-4429-b305-f4a27ae1f2a1" status: 202 len: 0 microversion: 2.20 time: 0.363732 Jul 19 15:51:25.283698 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 401/857] 10.222.0.64 () {60 vars in 1456 bytes} [Tue Jul 19 15:51:24 2022] DELETE /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0/os-volume_attachments/a733a2e5-9c12-4429-b305-f4a27ae1f2a1 => generated 0 bytes in 366 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 19 15:51:25.343713 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-a4f2e249-b88d-40c2-8cca-22a06f07e7e5 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:51:25.344279 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-a4f2e249-b88d-40c2-8cca-22a06f07e7e5 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: df3309b1-ba0f-4f40-937f-fc95c9c8f6a0] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:25.350326 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-a4f2e249-b88d-40c2-8cca-22a06f07e7e5 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:25.350805 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-a4f2e249-b88d-40c2-8cca-22a06f07e7e5 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:25.351561 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-a4f2e249-b88d-40c2-8cca-22a06f07e7e5 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:25.351996 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-a4f2e249-b88d-40c2-8cca-22a06f07e7e5 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:25.459108 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-a4f2e249-b88d-40c2-8cca-22a06f07e7e5 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "POST /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0/action" status: 202 len: 0 microversion: 2.20 time: 0.119780 Jul 19 15:51:25.464133 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 457/858] 10.222.0.64 () {62 vars in 1318 bytes} [Tue Jul 19 15:51:25 2022] POST /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 19 15:51:25.467774 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-59de7893-7545-44d8-8413-9fb885f2cf83 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:25.469103 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-59de7893-7545-44d8-8413-9fb885f2cf83 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: df3309b1-ba0f-4f40-937f-fc95c9c8f6a0] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:25.475960 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-59de7893-7545-44d8-8413-9fb885f2cf83 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:25.476422 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-59de7893-7545-44d8-8413-9fb885f2cf83 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:25.477188 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-59de7893-7545-44d8-8413-9fb885f2cf83 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:25.477797 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-59de7893-7545-44d8-8413-9fb885f2cf83 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:25.623685 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-59de7893-7545-44d8-8413-9fb885f2cf83 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:25.632658 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-59de7893-7545-44d8-8413-9fb885f2cf83 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:25.634171 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-59de7893-7545-44d8-8413-9fb885f2cf83 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:25.635487 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-59de7893-7545-44d8-8413-9fb885f2cf83 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0" status: 200 len: 1674 microversion: 2.20 time: 0.171488 Jul 19 15:51:25.636069 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 402/859] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:51:25 2022] GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0 => generated 1674 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:51:25.761097 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-8c556113-4f99-46a7-b259-191f551f8ea0 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:25.761686 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-8c556113-4f99-46a7-b259-191f551f8ea0 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: ef0f43ac-fd71-43ae-9213-9c3ab5f59161] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:25.764646 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG dbcounter [-] [129520] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=129520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:51:25.770113 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-8c556113-4f99-46a7-b259-191f551f8ea0 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:25.770590 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-8c556113-4f99-46a7-b259-191f551f8ea0 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:25.771361 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-8c556113-4f99-46a7-b259-191f551f8ea0 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:25.771793 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-8c556113-4f99-46a7-b259-191f551f8ea0 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:25.912403 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-8c556113-4f99-46a7-b259-191f551f8ea0 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7c42cf0bc84292bb0b7edb9f2e7fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a72d232f314a78b0e1c3f04b0ed682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:25.920349 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-8c556113-4f99-46a7-b259-191f551f8ea0 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/ef0f43ac-fd71-43ae-9213-9c3ab5f59161" status: 200 len: 1366 microversion: 2.1 time: 0.162996 Jul 19 15:51:25.920921 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 458/860] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:51:25 2022] GET /compute/v2.1/servers/ef0f43ac-fd71-43ae-9213-9c3ab5f59161 => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:51:26.203664 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-59a62a73-c4f6-46cc-b08a-7ee6f22777b2 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:26.207575 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-59a62a73-c4f6-46cc-b08a-7ee6f22777b2 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] [instance: d978b05a-906b-47db-8f20-9a7daaaf67f1] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:26.212413 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-59a62a73-c4f6-46cc-b08a-7ee6f22777b2 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:26.213217 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-59a62a73-c4f6-46cc-b08a-7ee6f22777b2 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:26.214644 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-59a62a73-c4f6-46cc-b08a-7ee6f22777b2 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:26.215360 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-59a62a73-c4f6-46cc-b08a-7ee6f22777b2 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:26.368378 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-59a62a73-c4f6-46cc-b08a-7ee6f22777b2 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae334c4d93cd4d3e94789a5985fcfa77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6827afcdf1f3481882f808dc01908a4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:26.377498 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-59a62a73-c4f6-46cc-b08a-7ee6f22777b2 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] 10.222.0.64 "GET /compute/v2.1/servers/d978b05a-906b-47db-8f20-9a7daaaf67f1" status: 200 len: 1265 microversion: 2.1 time: 0.178114 Jul 19 15:51:26.381373 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 403/861] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:51:26 2022] GET /compute/v2.1/servers/d978b05a-906b-47db-8f20-9a7daaaf67f1 => generated 1265 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:51:26.654914 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-f4e6d450-5a8e-4809-9a27-e09a5ebcbd87 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:26.657610 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-f4e6d450-5a8e-4809-9a27-e09a5ebcbd87 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: df3309b1-ba0f-4f40-937f-fc95c9c8f6a0] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:26.664677 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-f4e6d450-5a8e-4809-9a27-e09a5ebcbd87 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:26.665379 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-f4e6d450-5a8e-4809-9a27-e09a5ebcbd87 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:26.666141 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-f4e6d450-5a8e-4809-9a27-e09a5ebcbd87 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:26.666730 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-f4e6d450-5a8e-4809-9a27-e09a5ebcbd87 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:26.824078 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-f4e6d450-5a8e-4809-9a27-e09a5ebcbd87 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:26.834530 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-f4e6d450-5a8e-4809-9a27-e09a5ebcbd87 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:26.834530 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-f4e6d450-5a8e-4809-9a27-e09a5ebcbd87 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:26.835897 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-f4e6d450-5a8e-4809-9a27-e09a5ebcbd87 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0" status: 200 len: 1674 microversion: 2.20 time: 0.185659 Jul 19 15:51:26.836490 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 459/862] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:51:26 2022] GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0 => generated 1674 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:51:26.896042 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [req-08ef794d-78b3-442b-81df-295e3d9b9ad1 req-b53d5559-773f-45fe-b015-d5976749219f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df3309b1-ba0f-4f40-937f-fc95c9c8f6a0", "name": "network-vif-unplugged", "status": "completed", "tag": "f79bc5b8-5b78-4990-ae5f-977bb42032bd"}]} {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:51:26.907201 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [req-08ef794d-78b3-442b-81df-295e3d9b9ad1 req-b53d5559-773f-45fe-b015-d5976749219f service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:26.907922 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [req-08ef794d-78b3-442b-81df-295e3d9b9ad1 req-b53d5559-773f-45fe-b015-d5976749219f service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:26.920338 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.compute.server_external_events [req-08ef794d-78b3-442b-81df-295e3d9b9ad1 req-b53d5559-773f-45fe-b015-d5976749219f service nova] Creating event network-vif-unplugged:f79bc5b8-5b78-4990-ae5f-977bb42032bd for instance df3309b1-ba0f-4f40-937f-fc95c9c8f6a0 on hv-cinder-84902 Jul 19 15:51:26.926791 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [req-08ef794d-78b3-442b-81df-295e3d9b9ad1 req-b53d5559-773f-45fe-b015-d5976749219f service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.034597 Jul 19 15:51:26.927388 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 404/863] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Jul 19 15:51:26 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:51:26.936994 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-1ba82700-7948-472f-96be-a772d01f5787 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:26.937605 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-1ba82700-7948-472f-96be-a772d01f5787 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: ef0f43ac-fd71-43ae-9213-9c3ab5f59161] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:26.943755 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-1ba82700-7948-472f-96be-a772d01f5787 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:26.944413 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-1ba82700-7948-472f-96be-a772d01f5787 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:26.945184 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-1ba82700-7948-472f-96be-a772d01f5787 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:26.945618 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-1ba82700-7948-472f-96be-a772d01f5787 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:27.086349 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-1ba82700-7948-472f-96be-a772d01f5787 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7c42cf0bc84292bb0b7edb9f2e7fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a72d232f314a78b0e1c3f04b0ed682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:27.094245 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-1ba82700-7948-472f-96be-a772d01f5787 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/ef0f43ac-fd71-43ae-9213-9c3ab5f59161" status: 200 len: 1555 microversion: 2.1 time: 0.161112 Jul 19 15:51:27.095045 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 460/864] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:51:26 2022] GET /compute/v2.1/servers/ef0f43ac-fd71-43ae-9213-9c3ab5f59161 => generated 1555 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:51:27.111406 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-aa8b0766-4454-4dfc-a967-d9d087035d3d tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:27.112124 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-aa8b0766-4454-4dfc-a967-d9d087035d3d tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: ef0f43ac-fd71-43ae-9213-9c3ab5f59161] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:27.120963 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-aa8b0766-4454-4dfc-a967-d9d087035d3d tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:27.121500 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-aa8b0766-4454-4dfc-a967-d9d087035d3d tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:27.122517 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-aa8b0766-4454-4dfc-a967-d9d087035d3d tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:27.123411 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-aa8b0766-4454-4dfc-a967-d9d087035d3d tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:27.209580 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-aa8b0766-4454-4dfc-a967-d9d087035d3d tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/ef0f43ac-fd71-43ae-9213-9c3ab5f59161/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.102457 Jul 19 15:51:27.210701 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 405/865] 10.222.0.64 () {58 vars in 1274 bytes} [Tue Jul 19 15:51:27 2022] GET /compute/v2.1/servers/ef0f43ac-fd71-43ae-9213-9c3ab5f59161/os-interface => generated 284 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:51:27.397986 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-137ef0c8-30a3-42a6-9d3c-5be37dd789ab tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:27.398915 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-137ef0c8-30a3-42a6-9d3c-5be37dd789ab tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] [instance: d978b05a-906b-47db-8f20-9a7daaaf67f1] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:27.405822 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-137ef0c8-30a3-42a6-9d3c-5be37dd789ab tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:27.406171 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-137ef0c8-30a3-42a6-9d3c-5be37dd789ab tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:27.410879 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-137ef0c8-30a3-42a6-9d3c-5be37dd789ab tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:27.414064 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-137ef0c8-30a3-42a6-9d3c-5be37dd789ab tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:27.752574 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-137ef0c8-30a3-42a6-9d3c-5be37dd789ab tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae334c4d93cd4d3e94789a5985fcfa77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6827afcdf1f3481882f808dc01908a4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:27.761311 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-137ef0c8-30a3-42a6-9d3c-5be37dd789ab tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] 10.222.0.64 "GET /compute/v2.1/servers/d978b05a-906b-47db-8f20-9a7daaaf67f1" status: 200 len: 1265 microversion: 2.1 time: 0.369999 Jul 19 15:51:27.761882 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 461/866] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:51:27 2022] GET /compute/v2.1/servers/d978b05a-906b-47db-8f20-9a7daaaf67f1 => generated 1265 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:51:27.856801 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-a5d6d9da-2a47-42a5-b3e0-8ec22d108179 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:27.858110 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-a5d6d9da-2a47-42a5-b3e0-8ec22d108179 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: df3309b1-ba0f-4f40-937f-fc95c9c8f6a0] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:27.865002 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-a5d6d9da-2a47-42a5-b3e0-8ec22d108179 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:27.865621 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-a5d6d9da-2a47-42a5-b3e0-8ec22d108179 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:27.866297 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-a5d6d9da-2a47-42a5-b3e0-8ec22d108179 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:27.866866 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-a5d6d9da-2a47-42a5-b3e0-8ec22d108179 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:28.179628 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-a5d6d9da-2a47-42a5-b3e0-8ec22d108179 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:28.193418 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-a5d6d9da-2a47-42a5-b3e0-8ec22d108179 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:28.196686 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-a5d6d9da-2a47-42a5-b3e0-8ec22d108179 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:28.198195 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-a5d6d9da-2a47-42a5-b3e0-8ec22d108179 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0" status: 200 len: 1732 microversion: 2.20 time: 0.345698 Jul 19 15:51:28.199796 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 406/867] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:51:27 2022] GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0 => generated 1732 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:51:28.529578 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [req-27ebab2e-c184-49fa-bd67-eff192f61b8f req-1d54932e-eaee-4d4b-ac17-67c5e900c7f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef0f43ac-fd71-43ae-9213-9c3ab5f59161", "tag": "b5584b46-dc66-4b7c-8ae4-94dc57d1af3b"}]} {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:51:28.540194 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [req-27ebab2e-c184-49fa-bd67-eff192f61b8f req-1d54932e-eaee-4d4b-ac17-67c5e900c7f7 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:28.540652 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [req-27ebab2e-c184-49fa-bd67-eff192f61b8f req-1d54932e-eaee-4d4b-ac17-67c5e900c7f7 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:28.553786 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.compute.server_external_events [req-27ebab2e-c184-49fa-bd67-eff192f61b8f req-1d54932e-eaee-4d4b-ac17-67c5e900c7f7 service nova] Creating event network-changed:b5584b46-dc66-4b7c-8ae4-94dc57d1af3b for instance ef0f43ac-fd71-43ae-9213-9c3ab5f59161 on hv-cinder-84902 Jul 19 15:51:28.560028 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [req-27ebab2e-c184-49fa-bd67-eff192f61b8f req-1d54932e-eaee-4d4b-ac17-67c5e900c7f7 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034932 Jul 19 15:51:28.567702 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 462/868] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Jul 19 15:51:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:51:28.779389 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-0f6fe8b4-1b73-4bae-9832-84640e5a081a tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:28.780011 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-0f6fe8b4-1b73-4bae-9832-84640e5a081a tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] [instance: d978b05a-906b-47db-8f20-9a7daaaf67f1] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:28.791392 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-0f6fe8b4-1b73-4bae-9832-84640e5a081a tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:28.791865 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-0f6fe8b4-1b73-4bae-9832-84640e5a081a tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:28.792650 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-0f6fe8b4-1b73-4bae-9832-84640e5a081a tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:28.793091 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-0f6fe8b4-1b73-4bae-9832-84640e5a081a tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:29.158767 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-0f6fe8b4-1b73-4bae-9832-84640e5a081a tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae334c4d93cd4d3e94789a5985fcfa77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6827afcdf1f3481882f808dc01908a4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:29.168941 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-0f6fe8b4-1b73-4bae-9832-84640e5a081a tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] 10.222.0.64 "GET /compute/v2.1/servers/d978b05a-906b-47db-8f20-9a7daaaf67f1" status: 200 len: 1265 microversion: 2.1 time: 0.393791 Jul 19 15:51:29.183150 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 407/869] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:51:28 2022] GET /compute/v2.1/servers/d978b05a-906b-47db-8f20-9a7daaaf67f1 => generated 1265 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:51:29.226191 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-10452df2-cd92-4dbd-8f6c-a0acf10c3dfa tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:29.230183 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-10452df2-cd92-4dbd-8f6c-a0acf10c3dfa tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: df3309b1-ba0f-4f40-937f-fc95c9c8f6a0] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:29.250399 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-10452df2-cd92-4dbd-8f6c-a0acf10c3dfa tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:29.251414 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-10452df2-cd92-4dbd-8f6c-a0acf10c3dfa tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:29.263333 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-10452df2-cd92-4dbd-8f6c-a0acf10c3dfa tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:29.264146 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-10452df2-cd92-4dbd-8f6c-a0acf10c3dfa tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:29.387792 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [req-58c0c88c-a221-413e-a83d-e6a8fa7f189c req-6076d6a5-3fa1-47b8-ab5a-a05770528b14 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d978b05a-906b-47db-8f20-9a7daaaf67f1", "name": "network-vif-plugged", "status": "completed", "tag": "b12bd5cf-7ec9-4e31-91c4-9d3a0b5e7d26"}]} {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:51:29.411122 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [req-58c0c88c-a221-413e-a83d-e6a8fa7f189c req-6076d6a5-3fa1-47b8-ab5a-a05770528b14 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:29.413107 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [req-58c0c88c-a221-413e-a83d-e6a8fa7f189c req-6076d6a5-3fa1-47b8-ab5a-a05770528b14 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:29.435035 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.compute.server_external_events [req-58c0c88c-a221-413e-a83d-e6a8fa7f189c req-6076d6a5-3fa1-47b8-ab5a-a05770528b14 service nova] Creating event network-vif-plugged:b12bd5cf-7ec9-4e31-91c4-9d3a0b5e7d26 for instance d978b05a-906b-47db-8f20-9a7daaaf67f1 on hv-cinder-84902 Jul 19 15:51:29.442665 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [req-58c0c88c-a221-413e-a83d-e6a8fa7f189c req-6076d6a5-3fa1-47b8-ab5a-a05770528b14 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059618 Jul 19 15:51:29.443975 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 408/870] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Jul 19 15:51:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 15:51:29.940338 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-10452df2-cd92-4dbd-8f6c-a0acf10c3dfa tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:29.951254 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-10452df2-cd92-4dbd-8f6c-a0acf10c3dfa tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:29.954440 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-10452df2-cd92-4dbd-8f6c-a0acf10c3dfa tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:29.956201 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-10452df2-cd92-4dbd-8f6c-a0acf10c3dfa tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0" status: 200 len: 1732 microversion: 2.20 time: 0.742199 Jul 19 15:51:29.956980 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 463/871] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:51:29 2022] GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0 => generated 1732 bytes in 744 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 15:51:30.192312 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-e0f7690c-776e-4af9-84bb-52bc397a34a9 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:30.196074 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-e0f7690c-776e-4af9-84bb-52bc397a34a9 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] [instance: d978b05a-906b-47db-8f20-9a7daaaf67f1] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:30.212117 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-e0f7690c-776e-4af9-84bb-52bc397a34a9 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:30.212835 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-e0f7690c-776e-4af9-84bb-52bc397a34a9 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:30.213936 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-e0f7690c-776e-4af9-84bb-52bc397a34a9 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:30.215015 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-e0f7690c-776e-4af9-84bb-52bc397a34a9 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:30.535763 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-e0f7690c-776e-4af9-84bb-52bc397a34a9 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae334c4d93cd4d3e94789a5985fcfa77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6827afcdf1f3481882f808dc01908a4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:30.551623 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-e0f7690c-776e-4af9-84bb-52bc397a34a9 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] 10.222.0.64 "GET /compute/v2.1/servers/d978b05a-906b-47db-8f20-9a7daaaf67f1" status: 200 len: 1265 microversion: 2.1 time: 0.365114 Jul 19 15:51:30.564913 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 409/872] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:51:30 2022] GET /compute/v2.1/servers/d978b05a-906b-47db-8f20-9a7daaaf67f1 => generated 1265 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:51:30.975429 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-767ec71a-29d0-40c9-b5e7-44db8eaa6fc8 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:30.976032 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-767ec71a-29d0-40c9-b5e7-44db8eaa6fc8 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: df3309b1-ba0f-4f40-937f-fc95c9c8f6a0] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:30.983129 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-767ec71a-29d0-40c9-b5e7-44db8eaa6fc8 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:30.984748 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-767ec71a-29d0-40c9-b5e7-44db8eaa6fc8 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:30.985804 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-767ec71a-29d0-40c9-b5e7-44db8eaa6fc8 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:30.986426 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-767ec71a-29d0-40c9-b5e7-44db8eaa6fc8 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:31.224874 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-767ec71a-29d0-40c9-b5e7-44db8eaa6fc8 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:31.234848 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-767ec71a-29d0-40c9-b5e7-44db8eaa6fc8 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:31.237799 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-767ec71a-29d0-40c9-b5e7-44db8eaa6fc8 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:31.239170 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-767ec71a-29d0-40c9-b5e7-44db8eaa6fc8 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0" status: 200 len: 1732 microversion: 2.20 time: 0.267847 Jul 19 15:51:31.248825 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 464/873] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:51:30 2022] GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0 => generated 1732 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:51:31.572593 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-514c6258-ce58-48e9-a089-30aef4334c02 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:31.573232 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-514c6258-ce58-48e9-a089-30aef4334c02 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] [instance: d978b05a-906b-47db-8f20-9a7daaaf67f1] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:31.588622 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-514c6258-ce58-48e9-a089-30aef4334c02 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:31.589356 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-514c6258-ce58-48e9-a089-30aef4334c02 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:31.590298 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-514c6258-ce58-48e9-a089-30aef4334c02 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:31.590983 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-514c6258-ce58-48e9-a089-30aef4334c02 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:31.805197 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-514c6258-ce58-48e9-a089-30aef4334c02 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae334c4d93cd4d3e94789a5985fcfa77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6827afcdf1f3481882f808dc01908a4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:31.815407 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-514c6258-ce58-48e9-a089-30aef4334c02 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] 10.222.0.64 "GET /compute/v2.1/servers/d978b05a-906b-47db-8f20-9a7daaaf67f1" status: 200 len: 1265 microversion: 2.1 time: 0.246694 Jul 19 15:51:31.831039 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 410/874] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:51:31 2022] GET /compute/v2.1/servers/d978b05a-906b-47db-8f20-9a7daaaf67f1 => generated 1265 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:51:32.257549 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-b68beb93-4c6c-4452-a7bf-f9b429f474aa tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:32.258239 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-b68beb93-4c6c-4452-a7bf-f9b429f474aa tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: df3309b1-ba0f-4f40-937f-fc95c9c8f6a0] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:32.273490 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b68beb93-4c6c-4452-a7bf-f9b429f474aa tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:32.274605 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b68beb93-4c6c-4452-a7bf-f9b429f474aa tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:32.275491 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b68beb93-4c6c-4452-a7bf-f9b429f474aa tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:32.276392 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b68beb93-4c6c-4452-a7bf-f9b429f474aa tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:32.502328 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-b68beb93-4c6c-4452-a7bf-f9b429f474aa tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:32.514614 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-b68beb93-4c6c-4452-a7bf-f9b429f474aa tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:32.516779 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-b68beb93-4c6c-4452-a7bf-f9b429f474aa tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:32.517966 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-b68beb93-4c6c-4452-a7bf-f9b429f474aa tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0" status: 200 len: 1732 microversion: 2.20 time: 0.264490 Jul 19 15:51:32.518544 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 465/875] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:51:32 2022] GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0 => generated 1732 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:51:32.840044 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-58c7e02c-609b-4b1a-b2a2-e5f502ba2ecf tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:32.841295 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-58c7e02c-609b-4b1a-b2a2-e5f502ba2ecf tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] [instance: d978b05a-906b-47db-8f20-9a7daaaf67f1] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:32.848025 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-58c7e02c-609b-4b1a-b2a2-e5f502ba2ecf tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:32.848479 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-58c7e02c-609b-4b1a-b2a2-e5f502ba2ecf tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:32.849246 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-58c7e02c-609b-4b1a-b2a2-e5f502ba2ecf tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:32.849683 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-58c7e02c-609b-4b1a-b2a2-e5f502ba2ecf tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:33.029798 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-58c7e02c-609b-4b1a-b2a2-e5f502ba2ecf tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae334c4d93cd4d3e94789a5985fcfa77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6827afcdf1f3481882f808dc01908a4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:33.037546 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-58c7e02c-609b-4b1a-b2a2-e5f502ba2ecf tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] 10.222.0.64 "GET /compute/v2.1/servers/d978b05a-906b-47db-8f20-9a7daaaf67f1" status: 200 len: 1265 microversion: 2.1 time: 0.201934 Jul 19 15:51:33.052724 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 411/876] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:51:32 2022] GET /compute/v2.1/servers/d978b05a-906b-47db-8f20-9a7daaaf67f1 => generated 1265 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:51:33.536310 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-e4e86cc8-74ed-462d-9ef9-9e00b8969cb2 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:33.536918 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-e4e86cc8-74ed-462d-9ef9-9e00b8969cb2 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: df3309b1-ba0f-4f40-937f-fc95c9c8f6a0] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:33.544265 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-e4e86cc8-74ed-462d-9ef9-9e00b8969cb2 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:33.544806 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-e4e86cc8-74ed-462d-9ef9-9e00b8969cb2 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:33.545808 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-e4e86cc8-74ed-462d-9ef9-9e00b8969cb2 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:33.547220 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-e4e86cc8-74ed-462d-9ef9-9e00b8969cb2 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:33.723313 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-e4e86cc8-74ed-462d-9ef9-9e00b8969cb2 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:33.733159 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-e4e86cc8-74ed-462d-9ef9-9e00b8969cb2 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:33.735608 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-e4e86cc8-74ed-462d-9ef9-9e00b8969cb2 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:33.737202 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-e4e86cc8-74ed-462d-9ef9-9e00b8969cb2 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0" status: 200 len: 1732 microversion: 2.20 time: 0.204870 Jul 19 15:51:33.738406 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 466/877] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:51:33 2022] GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0 => generated 1732 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 15:51:34.054532 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-666f0737-84ce-4c56-97ab-ef1557f15c34 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:34.055142 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-666f0737-84ce-4c56-97ab-ef1557f15c34 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] [instance: d978b05a-906b-47db-8f20-9a7daaaf67f1] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:34.061447 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-666f0737-84ce-4c56-97ab-ef1557f15c34 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:34.062737 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-666f0737-84ce-4c56-97ab-ef1557f15c34 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:34.063600 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-666f0737-84ce-4c56-97ab-ef1557f15c34 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:34.064235 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-666f0737-84ce-4c56-97ab-ef1557f15c34 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:34.235178 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-666f0737-84ce-4c56-97ab-ef1557f15c34 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae334c4d93cd4d3e94789a5985fcfa77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6827afcdf1f3481882f808dc01908a4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:34.243252 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-666f0737-84ce-4c56-97ab-ef1557f15c34 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] 10.222.0.64 "GET /compute/v2.1/servers/d978b05a-906b-47db-8f20-9a7daaaf67f1" status: 200 len: 1265 microversion: 2.1 time: 0.192705 Jul 19 15:51:34.253552 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 412/878] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:51:34 2022] GET /compute/v2.1/servers/d978b05a-906b-47db-8f20-9a7daaaf67f1 => generated 1265 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:51:34.764891 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-4c84c784-0869-4aa2-871c-5d32e5f19b08 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:34.766206 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-4c84c784-0869-4aa2-871c-5d32e5f19b08 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: df3309b1-ba0f-4f40-937f-fc95c9c8f6a0] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:34.773490 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-4c84c784-0869-4aa2-871c-5d32e5f19b08 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:34.774204 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-4c84c784-0869-4aa2-871c-5d32e5f19b08 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:34.775180 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-4c84c784-0869-4aa2-871c-5d32e5f19b08 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:34.775782 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-4c84c784-0869-4aa2-871c-5d32e5f19b08 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:34.941436 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-4c84c784-0869-4aa2-871c-5d32e5f19b08 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:34.950094 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-4c84c784-0869-4aa2-871c-5d32e5f19b08 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:34.957382 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-4c84c784-0869-4aa2-871c-5d32e5f19b08 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:34.960466 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-4c84c784-0869-4aa2-871c-5d32e5f19b08 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0" status: 200 len: 1732 microversion: 2.20 time: 0.204883 Jul 19 15:51:34.980962 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 467/879] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:51:34 2022] GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0 => generated 1732 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:51:35.261283 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-ed78f333-c4a6-46e9-b8cc-018337242d79 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:35.262129 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-ed78f333-c4a6-46e9-b8cc-018337242d79 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] [instance: d978b05a-906b-47db-8f20-9a7daaaf67f1] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:35.271007 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-ed78f333-c4a6-46e9-b8cc-018337242d79 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:35.271996 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-ed78f333-c4a6-46e9-b8cc-018337242d79 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:35.273158 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-ed78f333-c4a6-46e9-b8cc-018337242d79 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:35.273962 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-ed78f333-c4a6-46e9-b8cc-018337242d79 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:35.431545 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-ed78f333-c4a6-46e9-b8cc-018337242d79 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae334c4d93cd4d3e94789a5985fcfa77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6827afcdf1f3481882f808dc01908a4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:35.439193 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-ed78f333-c4a6-46e9-b8cc-018337242d79 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] 10.222.0.64 "GET /compute/v2.1/servers/d978b05a-906b-47db-8f20-9a7daaaf67f1" status: 200 len: 1265 microversion: 2.1 time: 0.182234 Jul 19 15:51:35.439762 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 413/880] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:51:35 2022] GET /compute/v2.1/servers/d978b05a-906b-47db-8f20-9a7daaaf67f1 => generated 1265 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:51:35.989801 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-01ab148c-867d-43e9-9dbd-63aae13f23c6 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:35.990720 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-01ab148c-867d-43e9-9dbd-63aae13f23c6 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: df3309b1-ba0f-4f40-937f-fc95c9c8f6a0] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:35.997565 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-01ab148c-867d-43e9-9dbd-63aae13f23c6 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:35.998155 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-01ab148c-867d-43e9-9dbd-63aae13f23c6 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:35.999031 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-01ab148c-867d-43e9-9dbd-63aae13f23c6 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:36.000301 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-01ab148c-867d-43e9-9dbd-63aae13f23c6 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:36.177289 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-01ab148c-867d-43e9-9dbd-63aae13f23c6 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:36.185747 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-01ab148c-867d-43e9-9dbd-63aae13f23c6 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:36.188276 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-01ab148c-867d-43e9-9dbd-63aae13f23c6 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:36.189542 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-01ab148c-867d-43e9-9dbd-63aae13f23c6 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0" status: 200 len: 1732 microversion: 2.20 time: 0.204542 Jul 19 15:51:36.190131 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 468/881] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:51:35 2022] GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0 => generated 1732 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:51:36.457477 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-58057986-405b-4aeb-ae94-7f2daa4e8160 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:36.458189 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-58057986-405b-4aeb-ae94-7f2daa4e8160 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] [instance: d978b05a-906b-47db-8f20-9a7daaaf67f1] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:36.466134 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-58057986-405b-4aeb-ae94-7f2daa4e8160 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:36.467107 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-58057986-405b-4aeb-ae94-7f2daa4e8160 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:36.467770 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-58057986-405b-4aeb-ae94-7f2daa4e8160 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:36.469142 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-58057986-405b-4aeb-ae94-7f2daa4e8160 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:36.613118 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-58057986-405b-4aeb-ae94-7f2daa4e8160 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae334c4d93cd4d3e94789a5985fcfa77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6827afcdf1f3481882f808dc01908a4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:36.620609 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-58057986-405b-4aeb-ae94-7f2daa4e8160 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] 10.222.0.64 "GET /compute/v2.1/servers/d978b05a-906b-47db-8f20-9a7daaaf67f1" status: 200 len: 1265 microversion: 2.1 time: 0.167976 Jul 19 15:51:36.621184 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 414/882] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:51:36 2022] GET /compute/v2.1/servers/d978b05a-906b-47db-8f20-9a7daaaf67f1 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:51:37.209327 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-d862f24f-f32c-499a-8824-6bca4e08ff1a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:37.209967 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-d862f24f-f32c-499a-8824-6bca4e08ff1a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: df3309b1-ba0f-4f40-937f-fc95c9c8f6a0] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:37.216607 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-d862f24f-f32c-499a-8824-6bca4e08ff1a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:37.217059 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-d862f24f-f32c-499a-8824-6bca4e08ff1a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:37.217854 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-d862f24f-f32c-499a-8824-6bca4e08ff1a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:37.218418 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-d862f24f-f32c-499a-8824-6bca4e08ff1a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:37.357359 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-d862f24f-f32c-499a-8824-6bca4e08ff1a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:37.366385 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-d862f24f-f32c-499a-8824-6bca4e08ff1a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:37.367995 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-d862f24f-f32c-499a-8824-6bca4e08ff1a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:37.369144 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-d862f24f-f32c-499a-8824-6bca4e08ff1a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0" status: 200 len: 1732 microversion: 2.20 time: 0.163704 Jul 19 15:51:37.369690 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 469/883] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:51:37 2022] GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0 => generated 1732 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:51:37.638174 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-80b7f11f-9a94-4503-8850-de5f88838f8d tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:37.638907 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-80b7f11f-9a94-4503-8850-de5f88838f8d tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] [instance: d978b05a-906b-47db-8f20-9a7daaaf67f1] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:37.652019 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-80b7f11f-9a94-4503-8850-de5f88838f8d tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:37.652576 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-80b7f11f-9a94-4503-8850-de5f88838f8d tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:37.653725 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-80b7f11f-9a94-4503-8850-de5f88838f8d tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:37.654464 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-80b7f11f-9a94-4503-8850-de5f88838f8d tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:37.794288 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-80b7f11f-9a94-4503-8850-de5f88838f8d tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae334c4d93cd4d3e94789a5985fcfa77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6827afcdf1f3481882f808dc01908a4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:37.802321 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-80b7f11f-9a94-4503-8850-de5f88838f8d tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] 10.222.0.64 "GET /compute/v2.1/servers/d978b05a-906b-47db-8f20-9a7daaaf67f1" status: 200 len: 1265 microversion: 2.1 time: 0.168096 Jul 19 15:51:37.803004 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 415/884] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:51:37 2022] GET /compute/v2.1/servers/d978b05a-906b-47db-8f20-9a7daaaf67f1 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:51:38.387362 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-b2449d5d-b0f4-4702-9901-dbf6b2f94a33 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:38.387969 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-b2449d5d-b0f4-4702-9901-dbf6b2f94a33 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: df3309b1-ba0f-4f40-937f-fc95c9c8f6a0] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:38.395872 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b2449d5d-b0f4-4702-9901-dbf6b2f94a33 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:38.396405 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b2449d5d-b0f4-4702-9901-dbf6b2f94a33 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:38.397355 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b2449d5d-b0f4-4702-9901-dbf6b2f94a33 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:38.397975 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b2449d5d-b0f4-4702-9901-dbf6b2f94a33 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:38.536646 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-b2449d5d-b0f4-4702-9901-dbf6b2f94a33 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:38.545276 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-b2449d5d-b0f4-4702-9901-dbf6b2f94a33 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:38.547506 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-b2449d5d-b0f4-4702-9901-dbf6b2f94a33 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:38.548803 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-b2449d5d-b0f4-4702-9901-dbf6b2f94a33 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0" status: 200 len: 1732 microversion: 2.20 time: 0.165219 Jul 19 15:51:38.549433 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 470/885] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:51:38 2022] GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0 => generated 1732 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:51:38.820207 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-4039a651-96bc-4a5b-8e08-aef13f130358 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:38.820788 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-4039a651-96bc-4a5b-8e08-aef13f130358 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] [instance: d978b05a-906b-47db-8f20-9a7daaaf67f1] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:38.827575 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-4039a651-96bc-4a5b-8e08-aef13f130358 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:38.828089 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-4039a651-96bc-4a5b-8e08-aef13f130358 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:38.828847 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-4039a651-96bc-4a5b-8e08-aef13f130358 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:38.829280 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-4039a651-96bc-4a5b-8e08-aef13f130358 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:38.833392 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG dbcounter [-] [129519] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=129519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:51:38.972128 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-4039a651-96bc-4a5b-8e08-aef13f130358 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae334c4d93cd4d3e94789a5985fcfa77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6827afcdf1f3481882f808dc01908a4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:38.979730 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-4039a651-96bc-4a5b-8e08-aef13f130358 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] 10.222.0.64 "GET /compute/v2.1/servers/d978b05a-906b-47db-8f20-9a7daaaf67f1" status: 200 len: 1265 microversion: 2.1 time: 0.163845 Jul 19 15:51:38.980735 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 416/886] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:51:38 2022] GET /compute/v2.1/servers/d978b05a-906b-47db-8f20-9a7daaaf67f1 => generated 1265 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:51:39.568315 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-9f2d6f67-7e6d-465a-913e-c4a75dc29b8e tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:39.568851 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-9f2d6f67-7e6d-465a-913e-c4a75dc29b8e tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: df3309b1-ba0f-4f40-937f-fc95c9c8f6a0] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:39.575347 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-9f2d6f67-7e6d-465a-913e-c4a75dc29b8e tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:39.575799 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-9f2d6f67-7e6d-465a-913e-c4a75dc29b8e tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:39.576564 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-9f2d6f67-7e6d-465a-913e-c4a75dc29b8e tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:39.577003 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-9f2d6f67-7e6d-465a-913e-c4a75dc29b8e tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:39.707033 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-9f2d6f67-7e6d-465a-913e-c4a75dc29b8e tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:39.715004 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-9f2d6f67-7e6d-465a-913e-c4a75dc29b8e tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:39.716521 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-9f2d6f67-7e6d-465a-913e-c4a75dc29b8e tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:39.717672 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-9f2d6f67-7e6d-465a-913e-c4a75dc29b8e tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0" status: 200 len: 1732 microversion: 2.20 time: 0.153422 Jul 19 15:51:39.718786 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 471/887] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:51:39 2022] GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0 => generated 1732 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:51:39.997113 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-b8253e02-3c10-4841-8352-321f2a52e964 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:39.997770 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-b8253e02-3c10-4841-8352-321f2a52e964 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] [instance: d978b05a-906b-47db-8f20-9a7daaaf67f1] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:40.004756 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-b8253e02-3c10-4841-8352-321f2a52e964 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:40.005205 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-b8253e02-3c10-4841-8352-321f2a52e964 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:40.005969 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-b8253e02-3c10-4841-8352-321f2a52e964 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:40.006430 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-b8253e02-3c10-4841-8352-321f2a52e964 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:40.137302 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-b8253e02-3c10-4841-8352-321f2a52e964 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae334c4d93cd4d3e94789a5985fcfa77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6827afcdf1f3481882f808dc01908a4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:40.144981 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-b8253e02-3c10-4841-8352-321f2a52e964 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] 10.222.0.64 "GET /compute/v2.1/servers/d978b05a-906b-47db-8f20-9a7daaaf67f1" status: 200 len: 1451 microversion: 2.1 time: 0.151863 Jul 19 15:51:40.145538 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 417/888] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:51:39 2022] GET /compute/v2.1/servers/d978b05a-906b-47db-8f20-9a7daaaf67f1 => generated 1451 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:51:40.160901 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-09cd307b-64ee-4e89-bd61-491380363d7b tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:40.161533 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-09cd307b-64ee-4e89-bd61-491380363d7b tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] [instance: d978b05a-906b-47db-8f20-9a7daaaf67f1] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:40.167804 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-09cd307b-64ee-4e89-bd61-491380363d7b tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:40.168255 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-09cd307b-64ee-4e89-bd61-491380363d7b tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:40.169012 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-09cd307b-64ee-4e89-bd61-491380363d7b tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:40.169450 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-09cd307b-64ee-4e89-bd61-491380363d7b tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:40.174152 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG dbcounter [-] [129520] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:51:40.302969 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-09cd307b-64ee-4e89-bd61-491380363d7b tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae334c4d93cd4d3e94789a5985fcfa77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6827afcdf1f3481882f808dc01908a4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:40.310811 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-09cd307b-64ee-4e89-bd61-491380363d7b tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] 10.222.0.64 "GET /compute/v2.1/servers/d978b05a-906b-47db-8f20-9a7daaaf67f1" status: 200 len: 1451 microversion: 2.1 time: 0.153654 Jul 19 15:51:40.311387 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 472/889] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:51:40 2022] GET /compute/v2.1/servers/d978b05a-906b-47db-8f20-9a7daaaf67f1 => generated 1451 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:51:40.737371 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-d33b5106-165a-4d78-8ad4-9d2a86af4dab tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:40.738032 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-d33b5106-165a-4d78-8ad4-9d2a86af4dab tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: df3309b1-ba0f-4f40-937f-fc95c9c8f6a0] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:40.744619 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-d33b5106-165a-4d78-8ad4-9d2a86af4dab tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:40.745287 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-d33b5106-165a-4d78-8ad4-9d2a86af4dab tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:40.746236 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-d33b5106-165a-4d78-8ad4-9d2a86af4dab tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:40.746929 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-d33b5106-165a-4d78-8ad4-9d2a86af4dab tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:41.007824 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-d33b5106-165a-4d78-8ad4-9d2a86af4dab tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:41.016265 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-d33b5106-165a-4d78-8ad4-9d2a86af4dab tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:41.017685 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-d33b5106-165a-4d78-8ad4-9d2a86af4dab tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:41.018863 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-d33b5106-165a-4d78-8ad4-9d2a86af4dab tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0" status: 200 len: 1732 microversion: 2.20 time: 0.286289 Jul 19 15:51:41.019413 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 418/890] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:51:40 2022] GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0 => generated 1732 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:51:42.037919 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-b0b581fe-4608-4c87-8aa3-26f175741318 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:42.038577 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-b0b581fe-4608-4c87-8aa3-26f175741318 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: df3309b1-ba0f-4f40-937f-fc95c9c8f6a0] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:42.045362 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b0b581fe-4608-4c87-8aa3-26f175741318 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:42.045807 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b0b581fe-4608-4c87-8aa3-26f175741318 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:42.047547 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b0b581fe-4608-4c87-8aa3-26f175741318 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:42.048085 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b0b581fe-4608-4c87-8aa3-26f175741318 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:42.182105 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-b0b581fe-4608-4c87-8aa3-26f175741318 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:42.190268 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-b0b581fe-4608-4c87-8aa3-26f175741318 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:42.191808 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-b0b581fe-4608-4c87-8aa3-26f175741318 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:42.192963 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-b0b581fe-4608-4c87-8aa3-26f175741318 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0" status: 200 len: 1732 microversion: 2.20 time: 0.159145 Jul 19 15:51:42.193536 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 473/891] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:51:42 2022] GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0 => generated 1732 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:51:42.261312 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [req-caef593d-0b29-46ad-ac94-f7432839d1da req-13800d56-3763-4296-8135-3a430f4b9c17 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d978b05a-906b-47db-8f20-9a7daaaf67f1", "tag": "b12bd5cf-7ec9-4e31-91c4-9d3a0b5e7d26"}]} {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:51:42.270565 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [req-caef593d-0b29-46ad-ac94-f7432839d1da req-13800d56-3763-4296-8135-3a430f4b9c17 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:42.271011 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [req-caef593d-0b29-46ad-ac94-f7432839d1da req-13800d56-3763-4296-8135-3a430f4b9c17 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:42.282513 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.compute.server_external_events [req-caef593d-0b29-46ad-ac94-f7432839d1da req-13800d56-3763-4296-8135-3a430f4b9c17 service nova] Creating event network-changed:b12bd5cf-7ec9-4e31-91c4-9d3a0b5e7d26 for instance d978b05a-906b-47db-8f20-9a7daaaf67f1 on hv-cinder-84902 Jul 19 15:51:42.287419 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [req-caef593d-0b29-46ad-ac94-f7432839d1da req-13800d56-3763-4296-8135-3a430f4b9c17 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029953 Jul 19 15:51:42.288336 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 419/892] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Jul 19 15:51:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:51:43.211410 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-c8fcbe6c-9b54-4ab7-8061-15fdf67f520b tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:43.212019 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-c8fcbe6c-9b54-4ab7-8061-15fdf67f520b tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: df3309b1-ba0f-4f40-937f-fc95c9c8f6a0] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:43.218976 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-c8fcbe6c-9b54-4ab7-8061-15fdf67f520b tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:43.219412 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-c8fcbe6c-9b54-4ab7-8061-15fdf67f520b tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:43.220379 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-c8fcbe6c-9b54-4ab7-8061-15fdf67f520b tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:43.220822 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-c8fcbe6c-9b54-4ab7-8061-15fdf67f520b tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:43.353714 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-c8fcbe6c-9b54-4ab7-8061-15fdf67f520b tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:43.362701 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-c8fcbe6c-9b54-4ab7-8061-15fdf67f520b tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:43.364278 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-c8fcbe6c-9b54-4ab7-8061-15fdf67f520b tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:43.365439 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-c8fcbe6c-9b54-4ab7-8061-15fdf67f520b tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0" status: 200 len: 1732 microversion: 2.20 time: 0.158191 Jul 19 15:51:43.365992 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 474/893] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:51:43 2022] GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0 => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:51:44.385061 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-470f2417-c0b9-4094-8727-bb358004dcc0 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:44.385670 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-470f2417-c0b9-4094-8727-bb358004dcc0 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: df3309b1-ba0f-4f40-937f-fc95c9c8f6a0] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:44.392401 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-470f2417-c0b9-4094-8727-bb358004dcc0 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:44.392931 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-470f2417-c0b9-4094-8727-bb358004dcc0 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:44.393796 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-470f2417-c0b9-4094-8727-bb358004dcc0 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:44.394310 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-470f2417-c0b9-4094-8727-bb358004dcc0 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:44.525259 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-470f2417-c0b9-4094-8727-bb358004dcc0 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:44.534004 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-470f2417-c0b9-4094-8727-bb358004dcc0 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:44.535605 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-470f2417-c0b9-4094-8727-bb358004dcc0 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:44.536753 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-470f2417-c0b9-4094-8727-bb358004dcc0 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0" status: 200 len: 1732 microversion: 2.20 time: 0.156661 Jul 19 15:51:44.537316 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 420/894] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:51:44 2022] GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0 => generated 1732 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:51:45.555286 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-b4f6417f-7934-47c8-8434-718f65b6f6bc tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:45.555818 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-b4f6417f-7934-47c8-8434-718f65b6f6bc tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: df3309b1-ba0f-4f40-937f-fc95c9c8f6a0] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:45.562763 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b4f6417f-7934-47c8-8434-718f65b6f6bc tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:45.563205 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b4f6417f-7934-47c8-8434-718f65b6f6bc tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:45.563956 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b4f6417f-7934-47c8-8434-718f65b6f6bc tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:45.564385 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b4f6417f-7934-47c8-8434-718f65b6f6bc tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:45.698812 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-b4f6417f-7934-47c8-8434-718f65b6f6bc tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:45.706897 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-b4f6417f-7934-47c8-8434-718f65b6f6bc tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:45.708409 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-b4f6417f-7934-47c8-8434-718f65b6f6bc tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:45.709565 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-b4f6417f-7934-47c8-8434-718f65b6f6bc tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0" status: 200 len: 1732 microversion: 2.20 time: 0.158236 Jul 19 15:51:45.710147 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 475/895] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:51:45 2022] GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0 => generated 1732 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:51:46.153177 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [req-c144e6f9-3e18-436f-aef3-97d6df98fe87 req-71a131c1-2523-41f2-9504-b6bec1cdd257 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df3309b1-ba0f-4f40-937f-fc95c9c8f6a0", "name": "network-vif-plugged", "status": "completed", "tag": "f79bc5b8-5b78-4990-ae5f-977bb42032bd"}]} {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:51:46.162352 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [req-c144e6f9-3e18-436f-aef3-97d6df98fe87 req-71a131c1-2523-41f2-9504-b6bec1cdd257 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:46.163246 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [req-c144e6f9-3e18-436f-aef3-97d6df98fe87 req-71a131c1-2523-41f2-9504-b6bec1cdd257 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:46.176775 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.compute.server_external_events [req-c144e6f9-3e18-436f-aef3-97d6df98fe87 req-71a131c1-2523-41f2-9504-b6bec1cdd257 service nova] Creating event network-vif-plugged:f79bc5b8-5b78-4990-ae5f-977bb42032bd for instance df3309b1-ba0f-4f40-937f-fc95c9c8f6a0 on hv-cinder-84902 Jul 19 15:51:46.181656 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [req-c144e6f9-3e18-436f-aef3-97d6df98fe87 req-71a131c1-2523-41f2-9504-b6bec1cdd257 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032161 Jul 19 15:51:46.182744 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 421/896] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Jul 19 15:51:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:51:46.728401 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-d7debb27-ae66-4efa-b50c-ed7bfd14ab62 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:46.729012 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-d7debb27-ae66-4efa-b50c-ed7bfd14ab62 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: df3309b1-ba0f-4f40-937f-fc95c9c8f6a0] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:46.736504 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-d7debb27-ae66-4efa-b50c-ed7bfd14ab62 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:46.736963 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-d7debb27-ae66-4efa-b50c-ed7bfd14ab62 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:46.737730 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-d7debb27-ae66-4efa-b50c-ed7bfd14ab62 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:46.738170 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-d7debb27-ae66-4efa-b50c-ed7bfd14ab62 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:46.869130 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-d7debb27-ae66-4efa-b50c-ed7bfd14ab62 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:46.877631 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-d7debb27-ae66-4efa-b50c-ed7bfd14ab62 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:46.879170 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-d7debb27-ae66-4efa-b50c-ed7bfd14ab62 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:46.880313 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-d7debb27-ae66-4efa-b50c-ed7bfd14ab62 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0" status: 200 len: 1732 microversion: 2.20 time: 0.155897 Jul 19 15:51:46.880866 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 476/897] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:51:46 2022] GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0 => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:51:47.288176 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-0e43b9d1-ba52-4e1b-905d-91eb290b2679 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:47.288790 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-0e43b9d1-ba52-4e1b-905d-91eb290b2679 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 95bf808e-8c6d-4702-b942-027288ec604a] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:47.295216 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-0e43b9d1-ba52-4e1b-905d-91eb290b2679 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:47.295672 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-0e43b9d1-ba52-4e1b-905d-91eb290b2679 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:47.296433 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-0e43b9d1-ba52-4e1b-905d-91eb290b2679 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:47.296871 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-0e43b9d1-ba52-4e1b-905d-91eb290b2679 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:47.319818 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-0e43b9d1-ba52-4e1b-905d-91eb290b2679 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "GET /compute/v2.1/servers/95bf808e-8c6d-4702-b942-027288ec604a/ips" status: 200 len: 147 microversion: 2.1 time: 0.199307 Jul 19 15:51:47.320367 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 422/898] 10.222.0.64 () {58 vars in 1247 bytes} [Tue Jul 19 15:51:47 2022] GET /compute/v2.1/servers/95bf808e-8c6d-4702-b942-027288ec604a/ips => generated 147 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:51:47.899000 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-d774849b-f2d9-474c-a28e-a1f4e00a1609 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:47.899614 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-d774849b-f2d9-474c-a28e-a1f4e00a1609 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: df3309b1-ba0f-4f40-937f-fc95c9c8f6a0] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:47.907644 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-d774849b-f2d9-474c-a28e-a1f4e00a1609 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:47.908256 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-d774849b-f2d9-474c-a28e-a1f4e00a1609 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:47.909205 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-d774849b-f2d9-474c-a28e-a1f4e00a1609 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:47.909605 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-d774849b-f2d9-474c-a28e-a1f4e00a1609 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:48.130383 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-d774849b-f2d9-474c-a28e-a1f4e00a1609 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:48.139189 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-d774849b-f2d9-474c-a28e-a1f4e00a1609 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:48.140810 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-d774849b-f2d9-474c-a28e-a1f4e00a1609 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:48.142089 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-d774849b-f2d9-474c-a28e-a1f4e00a1609 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0" status: 200 len: 1732 microversion: 2.20 time: 0.247047 Jul 19 15:51:48.142723 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 477/899] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:51:47 2022] GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0 => generated 1732 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:51:48.648442 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-cc324e8d-b6e5-4da0-bab5-557e883dfe1a tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4e56b12c-6582-4545-8d27-ae9e5b6e6a20"}} {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:51:48.649545 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-cc324e8d-b6e5-4da0-bab5-557e883dfe1a tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 95bf808e-8c6d-4702-b942-027288ec604a] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:48.656111 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-cc324e8d-b6e5-4da0-bab5-557e883dfe1a tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:48.656575 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-cc324e8d-b6e5-4da0-bab5-557e883dfe1a tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:48.657530 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-cc324e8d-b6e5-4da0-bab5-557e883dfe1a tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:48.657955 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-cc324e8d-b6e5-4da0-bab5-557e883dfe1a tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:49.134948 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-cc324e8d-b6e5-4da0-bab5-557e883dfe1a tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "POST /compute/v2.1/servers/95bf808e-8c6d-4702-b942-027288ec604a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.490225 Jul 19 15:51:49.135547 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 423/900] 10.222.0.64 () {60 vars in 1322 bytes} [Tue Jul 19 15:51:48 2022] POST /compute/v2.1/servers/95bf808e-8c6d-4702-b942-027288ec604a/os-volume_attachments => generated 194 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:51:49.163592 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-5adcb3a8-ddfd-4869-ba39-069c6c7ec6dd tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:49.164266 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-5adcb3a8-ddfd-4869-ba39-069c6c7ec6dd tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: df3309b1-ba0f-4f40-937f-fc95c9c8f6a0] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:49.171238 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-5adcb3a8-ddfd-4869-ba39-069c6c7ec6dd tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:49.171918 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-5adcb3a8-ddfd-4869-ba39-069c6c7ec6dd tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:49.174000 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-5adcb3a8-ddfd-4869-ba39-069c6c7ec6dd tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:49.174807 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-5adcb3a8-ddfd-4869-ba39-069c6c7ec6dd tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:49.321308 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-5adcb3a8-ddfd-4869-ba39-069c6c7ec6dd tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:49.329915 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-5adcb3a8-ddfd-4869-ba39-069c6c7ec6dd tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:49.331544 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-5adcb3a8-ddfd-4869-ba39-069c6c7ec6dd tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:49.332691 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-5adcb3a8-ddfd-4869-ba39-069c6c7ec6dd tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0" status: 200 len: 1732 microversion: 2.20 time: 0.173138 Jul 19 15:51:49.333247 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 478/901] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:51:49 2022] GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0 => generated 1732 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:51:50.353249 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-27d72c27-4f7d-491f-9f19-d0188bd56a8b tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:50.354060 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-27d72c27-4f7d-491f-9f19-d0188bd56a8b tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: df3309b1-ba0f-4f40-937f-fc95c9c8f6a0] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:50.364236 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-27d72c27-4f7d-491f-9f19-d0188bd56a8b tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:50.364236 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-27d72c27-4f7d-491f-9f19-d0188bd56a8b tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:50.364236 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-27d72c27-4f7d-491f-9f19-d0188bd56a8b tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:50.364236 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-27d72c27-4f7d-491f-9f19-d0188bd56a8b tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:50.527355 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-27d72c27-4f7d-491f-9f19-d0188bd56a8b tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:50.537022 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-27d72c27-4f7d-491f-9f19-d0188bd56a8b tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:50.538570 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-27d72c27-4f7d-491f-9f19-d0188bd56a8b tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:50.539734 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-27d72c27-4f7d-491f-9f19-d0188bd56a8b tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0" status: 200 len: 1732 microversion: 2.20 time: 0.192124 Jul 19 15:51:50.540298 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 424/902] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:51:50 2022] GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0 => generated 1732 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:51:51.558717 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-89e058a8-d98f-4e05-9e7d-7a1b9c15d579 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:51.559333 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-89e058a8-d98f-4e05-9e7d-7a1b9c15d579 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: df3309b1-ba0f-4f40-937f-fc95c9c8f6a0] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:51.566804 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-89e058a8-d98f-4e05-9e7d-7a1b9c15d579 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:51.567357 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-89e058a8-d98f-4e05-9e7d-7a1b9c15d579 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:51.568459 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-89e058a8-d98f-4e05-9e7d-7a1b9c15d579 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:51.569076 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-89e058a8-d98f-4e05-9e7d-7a1b9c15d579 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:51.709413 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-89e058a8-d98f-4e05-9e7d-7a1b9c15d579 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:51.717423 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-89e058a8-d98f-4e05-9e7d-7a1b9c15d579 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:51.718991 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-89e058a8-d98f-4e05-9e7d-7a1b9c15d579 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:51:51.720699 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-89e058a8-d98f-4e05-9e7d-7a1b9c15d579 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0" status: 200 len: 1719 microversion: 2.20 time: 0.165955 Jul 19 15:51:51.721252 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 479/903] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:51:51 2022] GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0 => generated 1719 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:51:56.643861 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-0c4c521e-1875-4658-8235-c806ca47fdb0 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:56.644837 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-0c4c521e-1875-4658-8235-c806ca47fdb0 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 95bf808e-8c6d-4702-b942-027288ec604a] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:56.648248 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG dbcounter [-] [129519] Writing DB stats nova_api:SELECT=59 {{(pid=129519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:51:56.654351 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-0c4c521e-1875-4658-8235-c806ca47fdb0 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:56.654837 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-0c4c521e-1875-4658-8235-c806ca47fdb0 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:56.655604 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-0c4c521e-1875-4658-8235-c806ca47fdb0 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:56.656076 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-0c4c521e-1875-4658-8235-c806ca47fdb0 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:56.687412 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-0c4c521e-1875-4658-8235-c806ca47fdb0 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "GET /compute/v2.1/servers/95bf808e-8c6d-4702-b942-027288ec604a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047959 Jul 19 15:51:56.687976 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 425/904] 10.222.0.64 () {58 vars in 1301 bytes} [Tue Jul 19 15:51:56 2022] GET /compute/v2.1/servers/95bf808e-8c6d-4702-b942-027288ec604a/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:51:56.698755 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-82e549c2-4d36-403f-8457-2067b4118803 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:51:56.699248 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-82e549c2-4d36-403f-8457-2067b4118803 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 95bf808e-8c6d-4702-b942-027288ec604a] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:56.701773 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG dbcounter [-] [129520] Writing DB stats nova_api:SELECT=43 {{(pid=129520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:51:56.707795 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-82e549c2-4d36-403f-8457-2067b4118803 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:56.708246 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-82e549c2-4d36-403f-8457-2067b4118803 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:56.709010 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-82e549c2-4d36-403f-8457-2067b4118803 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:56.709441 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-82e549c2-4d36-403f-8457-2067b4118803 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:56.738532 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-82e549c2-4d36-403f-8457-2067b4118803 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "GET /compute/v2.1/servers/95bf808e-8c6d-4702-b942-027288ec604a/os-volume_attachments/4e56b12c-6582-4545-8d27-ae9e5b6e6a20" status: 200 len: 194 microversion: 2.1 time: 0.043654 Jul 19 15:51:56.739115 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 480/905] 10.222.0.64 () {58 vars in 1412 bytes} [Tue Jul 19 15:51:56 2022] GET /compute/v2.1/servers/95bf808e-8c6d-4702-b942-027288ec604a/os-volume_attachments/4e56b12c-6582-4545-8d27-ae9e5b6e6a20 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:51:58.046880 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-481ee4fc-bb7a-4792-a93b-c0f0dc9b4cd6 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "901edda3-8fba-4c9c-b341-24e8eccd070c"}} {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:51:58.047924 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-481ee4fc-bb7a-4792-a93b-c0f0dc9b4cd6 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 95bf808e-8c6d-4702-b942-027288ec604a] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:51:58.054847 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-481ee4fc-bb7a-4792-a93b-c0f0dc9b4cd6 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:58.055289 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-481ee4fc-bb7a-4792-a93b-c0f0dc9b4cd6 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:58.056041 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-481ee4fc-bb7a-4792-a93b-c0f0dc9b4cd6 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:51:58.056469 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-481ee4fc-bb7a-4792-a93b-c0f0dc9b4cd6 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:51:58.293224 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-481ee4fc-bb7a-4792-a93b-c0f0dc9b4cd6 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "POST /compute/v2.1/servers/95bf808e-8c6d-4702-b942-027288ec604a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.249893 Jul 19 15:51:58.293855 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 426/906] 10.222.0.64 () {60 vars in 1322 bytes} [Tue Jul 19 15:51:58 2022] POST /compute/v2.1/servers/95bf808e-8c6d-4702-b942-027288ec604a/os-volume_attachments => generated 194 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:52:05.806490 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-da28437a-ccf8-40df-abb2-acae857c99e8 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:05.807532 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-da28437a-ccf8-40df-abb2-acae857c99e8 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 95bf808e-8c6d-4702-b942-027288ec604a] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:52:05.814200 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-da28437a-ccf8-40df-abb2-acae857c99e8 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:05.815357 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-da28437a-ccf8-40df-abb2-acae857c99e8 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:05.816138 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-da28437a-ccf8-40df-abb2-acae857c99e8 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:05.816581 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-da28437a-ccf8-40df-abb2-acae857c99e8 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:05.849591 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-da28437a-ccf8-40df-abb2-acae857c99e8 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "GET /compute/v2.1/servers/95bf808e-8c6d-4702-b942-027288ec604a/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047040 Jul 19 15:52:05.850152 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 481/907] 10.222.0.64 () {58 vars in 1301 bytes} [Tue Jul 19 15:52:05 2022] GET /compute/v2.1/servers/95bf808e-8c6d-4702-b942-027288ec604a/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:52:05.993878 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-659c2a77-4ea0-4ded-a355-cb31231e63e1 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:05.994628 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-659c2a77-4ea0-4ded-a355-cb31231e63e1 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 95bf808e-8c6d-4702-b942-027288ec604a] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:52:06.001458 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-659c2a77-4ea0-4ded-a355-cb31231e63e1 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:06.002567 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-659c2a77-4ea0-4ded-a355-cb31231e63e1 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:06.003836 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-659c2a77-4ea0-4ded-a355-cb31231e63e1 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:06.004523 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-659c2a77-4ea0-4ded-a355-cb31231e63e1 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:06.038862 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-659c2a77-4ea0-4ded-a355-cb31231e63e1 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "GET /compute/v2.1/servers/95bf808e-8c6d-4702-b942-027288ec604a/os-volume_attachments/4e56b12c-6582-4545-8d27-ae9e5b6e6a20" status: 200 len: 194 microversion: 2.1 time: 0.049958 Jul 19 15:52:06.044175 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 427/908] 10.222.0.64 () {58 vars in 1412 bytes} [Tue Jul 19 15:52:05 2022] GET /compute/v2.1/servers/95bf808e-8c6d-4702-b942-027288ec604a/os-volume_attachments/4e56b12c-6582-4545-8d27-ae9e5b6e6a20 => generated 194 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 15:52:06.049803 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-d2c09341-3119-4cba-9f8b-e971f76140ae tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:06.050324 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-d2c09341-3119-4cba-9f8b-e971f76140ae tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 95bf808e-8c6d-4702-b942-027288ec604a] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:52:06.056296 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-d2c09341-3119-4cba-9f8b-e971f76140ae tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:06.056744 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-d2c09341-3119-4cba-9f8b-e971f76140ae tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:06.057501 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-d2c09341-3119-4cba-9f8b-e971f76140ae tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:06.057937 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-d2c09341-3119-4cba-9f8b-e971f76140ae tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:06.140675 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.objects.instance [None req-d2c09341-3119-4cba-9f8b-e971f76140ae tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lazy-loading 'services' on Instance uuid 95bf808e-8c6d-4702-b942-027288ec604a {{(pid=129520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 15:52:06.213575 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-d2c09341-3119-4cba-9f8b-e971f76140ae tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "DELETE /compute/v2.1/servers/95bf808e-8c6d-4702-b942-027288ec604a/os-volume_attachments/4e56b12c-6582-4545-8d27-ae9e5b6e6a20" status: 202 len: 0 microversion: 2.1 time: 0.167789 Jul 19 15:52:06.214135 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 482/909] 10.222.0.64 () {58 vars in 1415 bytes} [Tue Jul 19 15:52:06 2022] DELETE /compute/v2.1/servers/95bf808e-8c6d-4702-b942-027288ec604a/os-volume_attachments/4e56b12c-6582-4545-8d27-ae9e5b6e6a20 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 15:52:07.334959 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-98e3a749-3a52-42d0-a24c-d41a8ad730a7 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:07.335566 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-98e3a749-3a52-42d0-a24c-d41a8ad730a7 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 95bf808e-8c6d-4702-b942-027288ec604a] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:52:07.341917 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-98e3a749-3a52-42d0-a24c-d41a8ad730a7 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:07.342376 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-98e3a749-3a52-42d0-a24c-d41a8ad730a7 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:07.343162 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-98e3a749-3a52-42d0-a24c-d41a8ad730a7 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:07.343603 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-98e3a749-3a52-42d0-a24c-d41a8ad730a7 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:07.375650 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-98e3a749-3a52-42d0-a24c-d41a8ad730a7 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "GET /compute/v2.1/servers/95bf808e-8c6d-4702-b942-027288ec604a/os-volume_attachments/901edda3-8fba-4c9c-b341-24e8eccd070c" status: 200 len: 194 microversion: 2.1 time: 0.045335 Jul 19 15:52:07.376433 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 428/910] 10.222.0.64 () {58 vars in 1412 bytes} [Tue Jul 19 15:52:07 2022] GET /compute/v2.1/servers/95bf808e-8c6d-4702-b942-027288ec604a/os-volume_attachments/901edda3-8fba-4c9c-b341-24e8eccd070c => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:52:07.387532 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-1a41e2a2-50be-4b20-8a0d-ed76938c26f8 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:07.388118 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-1a41e2a2-50be-4b20-8a0d-ed76938c26f8 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 95bf808e-8c6d-4702-b942-027288ec604a] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:52:07.395332 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-1a41e2a2-50be-4b20-8a0d-ed76938c26f8 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:07.395851 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-1a41e2a2-50be-4b20-8a0d-ed76938c26f8 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:07.397034 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-1a41e2a2-50be-4b20-8a0d-ed76938c26f8 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:07.397142 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-1a41e2a2-50be-4b20-8a0d-ed76938c26f8 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:07.482694 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.objects.instance [None req-1a41e2a2-50be-4b20-8a0d-ed76938c26f8 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lazy-loading 'services' on Instance uuid 95bf808e-8c6d-4702-b942-027288ec604a {{(pid=129520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 15:52:07.562883 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-1a41e2a2-50be-4b20-8a0d-ed76938c26f8 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "DELETE /compute/v2.1/servers/95bf808e-8c6d-4702-b942-027288ec604a/os-volume_attachments/901edda3-8fba-4c9c-b341-24e8eccd070c" status: 202 len: 0 microversion: 2.1 time: 0.180079 Jul 19 15:52:07.563732 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 483/911] 10.222.0.64 () {58 vars in 1415 bytes} [Tue Jul 19 15:52:07 2022] DELETE /compute/v2.1/servers/95bf808e-8c6d-4702-b942-027288ec604a/os-volume_attachments/901edda3-8fba-4c9c-b341-24e8eccd070c => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 15:52:08.731204 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-939562bd-e016-4acd-befb-6f3a2f2fa860 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:08.732129 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-939562bd-e016-4acd-befb-6f3a2f2fa860 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 95bf808e-8c6d-4702-b942-027288ec604a] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:52:08.738647 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-939562bd-e016-4acd-befb-6f3a2f2fa860 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:08.739094 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-939562bd-e016-4acd-befb-6f3a2f2fa860 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:08.739864 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-939562bd-e016-4acd-befb-6f3a2f2fa860 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:08.740306 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-939562bd-e016-4acd-befb-6f3a2f2fa860 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:08.776760 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-939562bd-e016-4acd-befb-6f3a2f2fa860 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "GET /compute/v2.1/servers/95bf808e-8c6d-4702-b942-027288ec604a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049491 Jul 19 15:52:08.777318 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 429/912] 10.222.0.64 () {58 vars in 1301 bytes} [Tue Jul 19 15:52:08 2022] GET /compute/v2.1/servers/95bf808e-8c6d-4702-b942-027288ec604a/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 15:52:08.880718 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-98bba206-c9da-46cc-a391-a897ca8d5518 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:08.881710 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-98bba206-c9da-46cc-a391-a897ca8d5518 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 95bf808e-8c6d-4702-b942-027288ec604a] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:52:08.887910 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-98bba206-c9da-46cc-a391-a897ca8d5518 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:08.888353 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-98bba206-c9da-46cc-a391-a897ca8d5518 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:08.889132 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-98bba206-c9da-46cc-a391-a897ca8d5518 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:08.889565 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-98bba206-c9da-46cc-a391-a897ca8d5518 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:08.918007 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-98bba206-c9da-46cc-a391-a897ca8d5518 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "GET /compute/v2.1/servers/95bf808e-8c6d-4702-b942-027288ec604a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042777 Jul 19 15:52:08.918571 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 484/913] 10.222.0.64 () {58 vars in 1301 bytes} [Tue Jul 19 15:52:08 2022] GET /compute/v2.1/servers/95bf808e-8c6d-4702-b942-027288ec604a/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 15:52:08.975353 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-9087bddd-b008-465f-8f1f-48d9e3e95ab0 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:08.975878 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-9087bddd-b008-465f-8f1f-48d9e3e95ab0 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 95bf808e-8c6d-4702-b942-027288ec604a] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:52:08.981946 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-9087bddd-b008-465f-8f1f-48d9e3e95ab0 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:08.982434 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-9087bddd-b008-465f-8f1f-48d9e3e95ab0 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:08.983186 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-9087bddd-b008-465f-8f1f-48d9e3e95ab0 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:08.983618 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-9087bddd-b008-465f-8f1f-48d9e3e95ab0 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:08.986492 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG dbcounter [-] [129519] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=129519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:52:09.011316 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-9087bddd-b008-465f-8f1f-48d9e3e95ab0 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 95bf808e-8c6d-4702-b942-027288ec604a] Going to try to terminate instance {{(pid=129519) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 15:52:09.086160 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-9087bddd-b008-465f-8f1f-48d9e3e95ab0 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "DELETE /compute/v2.1/servers/95bf808e-8c6d-4702-b942-027288ec604a" status: 204 len: 0 microversion: 2.1 time: 0.114343 Jul 19 15:52:09.086778 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 430/914] 10.222.0.64 () {58 vars in 1238 bytes} [Tue Jul 19 15:52:08 2022] DELETE /compute/v2.1/servers/95bf808e-8c6d-4702-b942-027288ec604a => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 15:52:09.094946 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-d7274e69-2a51-42c4-a224-38132daa0d7e tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:09.095547 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-d7274e69-2a51-42c4-a224-38132daa0d7e tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 95bf808e-8c6d-4702-b942-027288ec604a] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:52:09.101442 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-d7274e69-2a51-42c4-a224-38132daa0d7e tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:09.101881 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-d7274e69-2a51-42c4-a224-38132daa0d7e tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:09.102650 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-d7274e69-2a51-42c4-a224-38132daa0d7e tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:09.103081 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-d7274e69-2a51-42c4-a224-38132daa0d7e tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:09.233430 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-d7274e69-2a51-42c4-a224-38132daa0d7e tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c75043813844d79fd0764132dfe4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e234f713b40cd8772372c2316dd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:52:09.241662 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-d7274e69-2a51-42c4-a224-38132daa0d7e tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "GET /compute/v2.1/servers/95bf808e-8c6d-4702-b942-027288ec604a" status: 200 len: 1674 microversion: 2.1 time: 0.150534 Jul 19 15:52:09.242227 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 485/915] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:52:09 2022] GET /compute/v2.1/servers/95bf808e-8c6d-4702-b942-027288ec604a => generated 1674 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:52:10.259654 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-66dd9a53-4018-4dca-935a-a80dec6f1251 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:10.260354 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-66dd9a53-4018-4dca-935a-a80dec6f1251 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 95bf808e-8c6d-4702-b942-027288ec604a] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:52:10.266835 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-66dd9a53-4018-4dca-935a-a80dec6f1251 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:10.267286 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-66dd9a53-4018-4dca-935a-a80dec6f1251 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:10.268641 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-66dd9a53-4018-4dca-935a-a80dec6f1251 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:10.269080 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-66dd9a53-4018-4dca-935a-a80dec6f1251 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:10.399913 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-66dd9a53-4018-4dca-935a-a80dec6f1251 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c75043813844d79fd0764132dfe4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e234f713b40cd8772372c2316dd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:52:10.407442 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-66dd9a53-4018-4dca-935a-a80dec6f1251 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "GET /compute/v2.1/servers/95bf808e-8c6d-4702-b942-027288ec604a" status: 200 len: 1674 microversion: 2.1 time: 0.152062 Jul 19 15:52:10.408019 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 431/916] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:52:10 2022] GET /compute/v2.1/servers/95bf808e-8c6d-4702-b942-027288ec604a => generated 1674 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:52:11.425272 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-a94554cd-e005-4d1a-9b91-36b5b6f98807 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:11.425871 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-a94554cd-e005-4d1a-9b91-36b5b6f98807 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 95bf808e-8c6d-4702-b942-027288ec604a] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:52:11.432780 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-a94554cd-e005-4d1a-9b91-36b5b6f98807 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:11.433216 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-a94554cd-e005-4d1a-9b91-36b5b6f98807 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:11.433994 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-a94554cd-e005-4d1a-9b91-36b5b6f98807 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:11.434464 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-a94554cd-e005-4d1a-9b91-36b5b6f98807 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:11.437380 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG dbcounter [-] [129520] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=2 {{(pid=129520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:52:11.661102 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-a94554cd-e005-4d1a-9b91-36b5b6f98807 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd9c75043813844d79fd0764132dfe4dd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e11e234f713b40cd8772372c2316dd28', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:52:11.676913 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-a94554cd-e005-4d1a-9b91-36b5b6f98807 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "GET /compute/v2.1/servers/95bf808e-8c6d-4702-b942-027288ec604a" status: 200 len: 1674 microversion: 2.1 time: 0.255458 Jul 19 15:52:11.678242 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 486/917] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:52:11 2022] GET /compute/v2.1/servers/95bf808e-8c6d-4702-b942-027288ec604a => generated 1674 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:52:12.053894 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [req-54822187-bc58-44cd-8818-61df9382ae19 req-34f291ab-3761-4c93-97d9-ea8175634d42 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "95bf808e-8c6d-4702-b942-027288ec604a", "name": "network-vif-deleted", "tag": "ebbcf9c9-0a61-4248-af0f-40d0e408b9f3"}]} {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:52:12.066325 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [req-54822187-bc58-44cd-8818-61df9382ae19 req-34f291ab-3761-4c93-97d9-ea8175634d42 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:12.066812 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [req-54822187-bc58-44cd-8818-61df9382ae19 req-34f291ab-3761-4c93-97d9-ea8175634d42 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:12.262492 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.compute.server_external_events [req-54822187-bc58-44cd-8818-61df9382ae19 req-34f291ab-3761-4c93-97d9-ea8175634d42 service nova] Creating event network-vif-deleted:ebbcf9c9-0a61-4248-af0f-40d0e408b9f3 for instance 95bf808e-8c6d-4702-b942-027288ec604a on hv-cinder-84902 Jul 19 15:52:12.268495 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [req-54822187-bc58-44cd-8818-61df9382ae19 req-34f291ab-3761-4c93-97d9-ea8175634d42 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.217714 Jul 19 15:52:12.269500 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 432/918] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Jul 19 15:52:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:52:12.694430 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-7f3a1809-a485-46c7-9240-320492b08593 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:12.695705 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-7f3a1809-a485-46c7-9240-320492b08593 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 95bf808e-8c6d-4702-b942-027288ec604a] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:52:12.702307 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-7f3a1809-a485-46c7-9240-320492b08593 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:12.702798 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-7f3a1809-a485-46c7-9240-320492b08593 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:12.703871 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-7f3a1809-a485-46c7-9240-320492b08593 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:12.704041 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-7f3a1809-a485-46c7-9240-320492b08593 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:12.718742 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.wsgi [None req-7f3a1809-a485-46c7-9240-320492b08593 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] HTTP exception thrown: Instance 95bf808e-8c6d-4702-b942-027288ec604a could not be found. Jul 19 15:52:12.720421 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-7f3a1809-a485-46c7-9240-320492b08593 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Request method failure captured: Jul 19 15:52:12.720421 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: request: GET /compute/v2.1/servers/95bf808e-8c6d-4702-b942-027288ec604a HTTP/1.1 Jul 19 15:52:12.720421 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Accept: application/json Jul 19 15:52:12.720421 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Accept-Encoding: identity Jul 19 15:52:12.720421 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Connection: close Jul 19 15:52:12.720421 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Content-Length: 0 Jul 19 15:52:12.720421 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Content-Type: application/json Jul 19 15:52:12.720421 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Host: 10.222.0.64 Jul 19 15:52:12.720421 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Openstack-System-Scope: None Jul 19 15:52:12.720421 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: User-Agent: python-urllib3/1.26.9 Jul 19 15:52:12.720421 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Auth-Token: gAAAAABi1tHeLm_LCBzz_Bg1FiUDtORDWFTPGXbpVJ2F6BGM4Zy_92gr2D50Ra8q_u960WvBhCTil5fIiRYXEiS_zgjeLu0y-flWKNola3MXcZpujx3jZswBWC8yY0g6OsKKmKOHe7r4WW6pan3Q3AW0Ymh_hKdosZEzin5vW0GmEeXr7WYkyxw Jul 19 15:52:12.720421 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Domain-Id: None Jul 19 15:52:12.720421 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Domain-Name: None Jul 19 15:52:12.720421 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Identity-Status: Confirmed Jul 19 15:52:12.720421 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Is-Admin-Project: True Jul 19 15:52:12.720421 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Project-Domain-Id: default Jul 19 15:52:12.720421 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Project-Domain-Name: Default Jul 19 15:52:12.720421 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Project-Id: e11e234f713b40cd8772372c2316dd28 Jul 19 15:52:12.720421 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Project-Name: tempest-AttachVolumeTestJSON-1928423787 Jul 19 15:52:12.720421 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Role: member,reader Jul 19 15:52:12.720421 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Roles: member,reader Jul 19 15:52:12.722271 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_e11e234f713b40cd8772372c2316dd28", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/e11e234f713b40cd8772372c2316dd28"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/e11e234f713b40cd8772372c2316dd28"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/e11e234f713b40cd8772372c2316dd28"}]}] Jul 19 15:52:12.722271 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Tenant: tempest-AttachVolumeTestJSON-1928423787 Jul 19 15:52:12.722271 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Tenant-Id: e11e234f713b40cd8772372c2316dd28 Jul 19 15:52:12.722271 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1928423787 Jul 19 15:52:12.722271 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User: tempest-AttachVolumeTestJSON-1928423787-project Jul 19 15:52:12.722271 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User-Domain-Id: default Jul 19 15:52:12.722271 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User-Domain-Name: Default Jul 19 15:52:12.722271 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User-Id: d9c75043813844d79fd0764132dfe4dd Jul 19 15:52:12.722271 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User-Name: tempest-AttachVolumeTestJSON-1928423787-project Jul 19 15:52:12.722271 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: method: > Jul 19 15:52:12.722271 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: exception: Instance 95bf808e-8c6d-4702-b942-027288ec604a could not be found. Jul 19 15:52:12.722271 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: action_args: {'id': '95bf808e-8c6d-4702-b942-027288ec604a'} Jul 19 15:52:12.723245 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:52:12.723245 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:52:12.723245 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 15:52:12.723245 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 15:52:12.723245 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 15:52:12.723245 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 15:52:12.723245 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 15:52:12.723245 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 15:52:12.723245 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 15:52:12.723245 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 15:52:12.723245 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95bf808e-8c6d-4702-b942-027288ec604a could not be found. Jul 19 15:52:12.723245 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:52:12.723245 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:52:12.723245 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:52:12.723245 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:52:12.723245 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:52:12.723245 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:52:12.723245 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:52:12.723245 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:52:12.723245 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:52:12.724628 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:52:12.724628 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 15:52:12.724628 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 15:52:12.724628 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 15:52:12.724628 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 15:52:12.724628 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 15:52:12.724628 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 15:52:12.724628 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95bf808e-8c6d-4702-b942-027288ec604a could not be found. Jul 19 15:52:12.724628 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:52:12.724628 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:52:12.724628 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:52:12.724628 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:52:12.724628 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:52:12.724628 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:52:12.724628 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:52:12.724628 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:52:12.724628 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95bf808e-8c6d-4702-b942-027288ec604a could not be found. Jul 19 15:52:12.724628 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:52:12.726586 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-7f3a1809-a485-46c7-9240-320492b08593 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Returning 404 to user: Instance 95bf808e-8c6d-4702-b942-027288ec604a could not be found. {{(pid=129520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:52:12.727464 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-7f3a1809-a485-46c7-9240-320492b08593 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "GET /compute/v2.1/servers/95bf808e-8c6d-4702-b942-027288ec604a" status: 404 len: 111 microversion: 2.1 time: 0.037861 Jul 19 15:52:12.728590 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 487/919] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:52:12 2022] GET /compute/v2.1/servers/95bf808e-8c6d-4702-b942-027288ec604a => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 15:52:12.740956 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-98a87dc9-0189-4775-b492-965fbacbe39c tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Calling method '.version_select at 0x7fb8a59cfd30>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:12.771529 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-98a87dc9-0189-4775-b492-965fbacbe39c tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1724742079" status: 202 len: 0 microversion: 2.1 time: 0.038333 Jul 19 15:52:12.772339 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 433/920] 10.222.0.64 () {58 vars in 1220 bytes} [Tue Jul 19 15:52:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1724742079 => generated 0 bytes in 40 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 15:52:14.039094 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-ec4f176b-0154-41f9-a278-823d6f67822a tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:14.039639 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-ec4f176b-0154-41f9-a278-823d6f67822a tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: ef0f43ac-fd71-43ae-9213-9c3ab5f59161] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:52:14.046247 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-ec4f176b-0154-41f9-a278-823d6f67822a tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:14.046729 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-ec4f176b-0154-41f9-a278-823d6f67822a tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:14.047495 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-ec4f176b-0154-41f9-a278-823d6f67822a tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:14.047958 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-ec4f176b-0154-41f9-a278-823d6f67822a tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:14.071570 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-ec4f176b-0154-41f9-a278-823d6f67822a tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/ef0f43ac-fd71-43ae-9213-9c3ab5f59161/ips" status: 200 len: 149 microversion: 2.1 time: 0.036446 Jul 19 15:52:14.072121 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 488/921] 10.222.0.64 () {58 vars in 1247 bytes} [Tue Jul 19 15:52:14 2022] GET /compute/v2.1/servers/ef0f43ac-fd71-43ae-9213-9c3ab5f59161/ips => generated 149 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:52:15.392305 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-0a78ca6a-262b-4787-a9ed-8b96bbb809b3 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "430d4314-3841-4ba1-8987-ba79c39806ee"}} {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:52:15.393630 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-0a78ca6a-262b-4787-a9ed-8b96bbb809b3 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: ef0f43ac-fd71-43ae-9213-9c3ab5f59161] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:52:15.400925 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-0a78ca6a-262b-4787-a9ed-8b96bbb809b3 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:15.401358 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-0a78ca6a-262b-4787-a9ed-8b96bbb809b3 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:15.402126 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-0a78ca6a-262b-4787-a9ed-8b96bbb809b3 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:15.402594 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-0a78ca6a-262b-4787-a9ed-8b96bbb809b3 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:15.648871 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-0a78ca6a-262b-4787-a9ed-8b96bbb809b3 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "POST /compute/v2.1/servers/ef0f43ac-fd71-43ae-9213-9c3ab5f59161/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.260774 Jul 19 15:52:15.649481 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 434/922] 10.222.0.64 () {60 vars in 1322 bytes} [Tue Jul 19 15:52:15 2022] POST /compute/v2.1/servers/ef0f43ac-fd71-43ae-9213-9c3ab5f59161/os-volume_attachments => generated 194 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:52:15.704675 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-c93af4b9-f257-4958-804b-ce7d1c46286e tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:15.705313 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-c93af4b9-f257-4958-804b-ce7d1c46286e tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 95bf808e-8c6d-4702-b942-027288ec604a] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:52:15.712404 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-c93af4b9-f257-4958-804b-ce7d1c46286e tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:15.712856 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-c93af4b9-f257-4958-804b-ce7d1c46286e tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:15.713628 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-c93af4b9-f257-4958-804b-ce7d1c46286e tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:15.714062 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-c93af4b9-f257-4958-804b-ce7d1c46286e tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:15.727915 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.wsgi [None req-c93af4b9-f257-4958-804b-ce7d1c46286e tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] HTTP exception thrown: Instance 95bf808e-8c6d-4702-b942-027288ec604a could not be found. Jul 19 15:52:15.729462 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-c93af4b9-f257-4958-804b-ce7d1c46286e tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Request method failure captured: Jul 19 15:52:15.729462 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: request: DELETE /compute/v2.1/servers/95bf808e-8c6d-4702-b942-027288ec604a HTTP/1.1 Jul 19 15:52:15.729462 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Accept: application/json Jul 19 15:52:15.729462 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Accept-Encoding: identity Jul 19 15:52:15.729462 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Connection: close Jul 19 15:52:15.729462 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Content-Length: 0 Jul 19 15:52:15.729462 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Content-Type: application/json Jul 19 15:52:15.729462 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Host: 10.222.0.64 Jul 19 15:52:15.729462 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Openstack-System-Scope: None Jul 19 15:52:15.729462 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: User-Agent: python-urllib3/1.26.9 Jul 19 15:52:15.729462 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Auth-Token: gAAAAABi1tHeLm_LCBzz_Bg1FiUDtORDWFTPGXbpVJ2F6BGM4Zy_92gr2D50Ra8q_u960WvBhCTil5fIiRYXEiS_zgjeLu0y-flWKNola3MXcZpujx3jZswBWC8yY0g6OsKKmKOHe7r4WW6pan3Q3AW0Ymh_hKdosZEzin5vW0GmEeXr7WYkyxw Jul 19 15:52:15.729462 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Domain-Id: None Jul 19 15:52:15.729462 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Domain-Name: None Jul 19 15:52:15.729462 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Identity-Status: Confirmed Jul 19 15:52:15.729462 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Is-Admin-Project: True Jul 19 15:52:15.729462 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Project-Domain-Id: default Jul 19 15:52:15.729462 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Project-Domain-Name: Default Jul 19 15:52:15.729462 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Project-Id: e11e234f713b40cd8772372c2316dd28 Jul 19 15:52:15.729462 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Project-Name: tempest-AttachVolumeTestJSON-1928423787 Jul 19 15:52:15.729462 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Role: member,reader Jul 19 15:52:15.729462 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Roles: member,reader Jul 19 15:52:15.731102 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_e11e234f713b40cd8772372c2316dd28", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/e11e234f713b40cd8772372c2316dd28"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/e11e234f713b40cd8772372c2316dd28"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/e11e234f713b40cd8772372c2316dd28"}]}] Jul 19 15:52:15.731102 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Tenant: tempest-AttachVolumeTestJSON-1928423787 Jul 19 15:52:15.731102 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Tenant-Id: e11e234f713b40cd8772372c2316dd28 Jul 19 15:52:15.731102 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1928423787 Jul 19 15:52:15.731102 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User: tempest-AttachVolumeTestJSON-1928423787-project Jul 19 15:52:15.731102 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User-Domain-Id: default Jul 19 15:52:15.731102 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User-Domain-Name: Default Jul 19 15:52:15.731102 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User-Id: d9c75043813844d79fd0764132dfe4dd Jul 19 15:52:15.731102 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User-Name: tempest-AttachVolumeTestJSON-1928423787-project Jul 19 15:52:15.731102 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: method: > Jul 19 15:52:15.731102 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: exception: Instance 95bf808e-8c6d-4702-b942-027288ec604a could not be found. Jul 19 15:52:15.731102 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: action_args: {'id': '95bf808e-8c6d-4702-b942-027288ec604a'} Jul 19 15:52:15.734420 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:52:15.734420 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:52:15.734420 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 15:52:15.734420 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 15:52:15.734420 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 15:52:15.734420 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 15:52:15.734420 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 15:52:15.734420 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 15:52:15.734420 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 15:52:15.734420 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 15:52:15.734420 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95bf808e-8c6d-4702-b942-027288ec604a could not be found. Jul 19 15:52:15.734420 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:52:15.734420 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:52:15.734420 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:52:15.734420 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:52:15.734420 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:52:15.734420 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:52:15.734420 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:52:15.734420 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:52:15.734420 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:52:15.736348 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:52:15.736348 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 15:52:15.736348 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 15:52:15.736348 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 15:52:15.736348 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 15:52:15.736348 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 15:52:15.736348 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 15:52:15.736348 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 15:52:15.736348 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 15:52:15.736348 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95bf808e-8c6d-4702-b942-027288ec604a could not be found. Jul 19 15:52:15.736348 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:52:15.736348 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:52:15.736348 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:52:15.736348 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:52:15.736348 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:52:15.736348 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:52:15.736348 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:52:15.736348 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:52:15.736348 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95bf808e-8c6d-4702-b942-027288ec604a could not be found. Jul 19 15:52:15.736348 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:52:15.738581 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-c93af4b9-f257-4958-804b-ce7d1c46286e tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Returning 404 to user: Instance 95bf808e-8c6d-4702-b942-027288ec604a could not be found. {{(pid=129520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:52:15.738581 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-c93af4b9-f257-4958-804b-ce7d1c46286e tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "DELETE /compute/v2.1/servers/95bf808e-8c6d-4702-b942-027288ec604a" status: 404 len: 111 microversion: 2.1 time: 0.031682 Jul 19 15:52:15.738581 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 489/923] 10.222.0.64 () {58 vars in 1238 bytes} [Tue Jul 19 15:52:15 2022] DELETE /compute/v2.1/servers/95bf808e-8c6d-4702-b942-027288ec604a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 15:52:15.742391 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-01cb80f4-926d-4d38-9e02-15146548df42 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:15.743079 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-01cb80f4-926d-4d38-9e02-15146548df42 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 95bf808e-8c6d-4702-b942-027288ec604a] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:52:15.749394 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-01cb80f4-926d-4d38-9e02-15146548df42 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:15.749846 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-01cb80f4-926d-4d38-9e02-15146548df42 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:15.750635 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-01cb80f4-926d-4d38-9e02-15146548df42 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:15.751090 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-01cb80f4-926d-4d38-9e02-15146548df42 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:15.771013 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.wsgi [None req-01cb80f4-926d-4d38-9e02-15146548df42 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] HTTP exception thrown: Instance 95bf808e-8c6d-4702-b942-027288ec604a could not be found. Jul 19 15:52:15.773609 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-01cb80f4-926d-4d38-9e02-15146548df42 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Request method failure captured: Jul 19 15:52:15.773609 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: request: GET /compute/v2.1/servers/95bf808e-8c6d-4702-b942-027288ec604a HTTP/1.1 Jul 19 15:52:15.773609 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Accept: application/json Jul 19 15:52:15.773609 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Accept-Encoding: identity Jul 19 15:52:15.773609 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Connection: close Jul 19 15:52:15.773609 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Content-Length: 0 Jul 19 15:52:15.773609 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Content-Type: application/json Jul 19 15:52:15.773609 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Host: 10.222.0.64 Jul 19 15:52:15.773609 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Openstack-System-Scope: None Jul 19 15:52:15.773609 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: User-Agent: python-urllib3/1.26.9 Jul 19 15:52:15.773609 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Auth-Token: gAAAAABi1tHeLm_LCBzz_Bg1FiUDtORDWFTPGXbpVJ2F6BGM4Zy_92gr2D50Ra8q_u960WvBhCTil5fIiRYXEiS_zgjeLu0y-flWKNola3MXcZpujx3jZswBWC8yY0g6OsKKmKOHe7r4WW6pan3Q3AW0Ymh_hKdosZEzin5vW0GmEeXr7WYkyxw Jul 19 15:52:15.773609 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Domain-Id: None Jul 19 15:52:15.773609 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Domain-Name: None Jul 19 15:52:15.773609 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Identity-Status: Confirmed Jul 19 15:52:15.773609 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Is-Admin-Project: True Jul 19 15:52:15.773609 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Domain-Id: default Jul 19 15:52:15.773609 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Domain-Name: Default Jul 19 15:52:15.773609 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Id: e11e234f713b40cd8772372c2316dd28 Jul 19 15:52:15.773609 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Name: tempest-AttachVolumeTestJSON-1928423787 Jul 19 15:52:15.773609 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Role: member,reader Jul 19 15:52:15.773609 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Roles: member,reader Jul 19 15:52:15.775429 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_e11e234f713b40cd8772372c2316dd28", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/e11e234f713b40cd8772372c2316dd28"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/e11e234f713b40cd8772372c2316dd28"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/e11e234f713b40cd8772372c2316dd28"}]}] Jul 19 15:52:15.775429 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Tenant: tempest-AttachVolumeTestJSON-1928423787 Jul 19 15:52:15.775429 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Tenant-Id: e11e234f713b40cd8772372c2316dd28 Jul 19 15:52:15.775429 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1928423787 Jul 19 15:52:15.775429 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User: tempest-AttachVolumeTestJSON-1928423787-project Jul 19 15:52:15.775429 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Domain-Id: default Jul 19 15:52:15.775429 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Domain-Name: Default Jul 19 15:52:15.775429 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Id: d9c75043813844d79fd0764132dfe4dd Jul 19 15:52:15.775429 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Name: tempest-AttachVolumeTestJSON-1928423787-project Jul 19 15:52:15.775429 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: method: > Jul 19 15:52:15.775429 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: exception: Instance 95bf808e-8c6d-4702-b942-027288ec604a could not be found. Jul 19 15:52:15.775429 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: action_args: {'id': '95bf808e-8c6d-4702-b942-027288ec604a'} Jul 19 15:52:15.776617 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:52:15.776617 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:52:15.776617 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 15:52:15.776617 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 15:52:15.776617 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 15:52:15.776617 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 15:52:15.776617 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 15:52:15.776617 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 15:52:15.776617 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 15:52:15.776617 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 15:52:15.776617 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 95bf808e-8c6d-4702-b942-027288ec604a could not be found. Jul 19 15:52:15.776617 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:52:15.776617 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:52:15.776617 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:52:15.776617 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:52:15.776617 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:52:15.776617 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:52:15.776617 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:52:15.776617 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:52:15.776617 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:52:15.777972 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:52:15.777972 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 15:52:15.777972 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 15:52:15.777972 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 15:52:15.777972 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 15:52:15.777972 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 15:52:15.777972 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 15:52:15.777972 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 95bf808e-8c6d-4702-b942-027288ec604a could not be found. Jul 19 15:52:15.777972 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:52:15.777972 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:52:15.777972 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:52:15.777972 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:52:15.777972 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:52:15.777972 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:52:15.777972 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:52:15.777972 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:52:15.777972 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 95bf808e-8c6d-4702-b942-027288ec604a could not be found. Jul 19 15:52:15.777972 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:52:15.779572 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-01cb80f4-926d-4d38-9e02-15146548df42 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Returning 404 to user: Instance 95bf808e-8c6d-4702-b942-027288ec604a could not be found. {{(pid=129519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:52:15.779572 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-01cb80f4-926d-4d38-9e02-15146548df42 tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "GET /compute/v2.1/servers/95bf808e-8c6d-4702-b942-027288ec604a" status: 404 len: 111 microversion: 2.1 time: 0.037920 Jul 19 15:52:15.779572 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 435/924] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:52:15 2022] GET /compute/v2.1/servers/95bf808e-8c6d-4702-b942-027288ec604a => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 15:52:16.911892 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-b4167128-d1eb-4026-a646-64ac3778d9ca tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:16.912376 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-b4167128-d1eb-4026-a646-64ac3778d9ca tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 343ae383-5bfd-4c70-8926-a800fcee3519] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:52:16.919395 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b4167128-d1eb-4026-a646-64ac3778d9ca tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:16.919840 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b4167128-d1eb-4026-a646-64ac3778d9ca tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:16.920602 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b4167128-d1eb-4026-a646-64ac3778d9ca tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:16.921036 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b4167128-d1eb-4026-a646-64ac3778d9ca tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:16.936252 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.wsgi [None req-b4167128-d1eb-4026-a646-64ac3778d9ca tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] HTTP exception thrown: Instance 343ae383-5bfd-4c70-8926-a800fcee3519 could not be found. Jul 19 15:52:16.937725 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-b4167128-d1eb-4026-a646-64ac3778d9ca tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Request method failure captured: Jul 19 15:52:16.937725 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: request: DELETE /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519 HTTP/1.1 Jul 19 15:52:16.937725 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Accept: application/json Jul 19 15:52:16.937725 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Accept-Encoding: identity Jul 19 15:52:16.937725 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Connection: close Jul 19 15:52:16.937725 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Content-Length: 0 Jul 19 15:52:16.937725 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Content-Type: application/json Jul 19 15:52:16.937725 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Host: 10.222.0.64 Jul 19 15:52:16.937725 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Openstack-System-Scope: None Jul 19 15:52:16.937725 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: User-Agent: python-urllib3/1.26.9 Jul 19 15:52:16.937725 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Auth-Token: gAAAAABi1tHeLm_LCBzz_Bg1FiUDtORDWFTPGXbpVJ2F6BGM4Zy_92gr2D50Ra8q_u960WvBhCTil5fIiRYXEiS_zgjeLu0y-flWKNola3MXcZpujx3jZswBWC8yY0g6OsKKmKOHe7r4WW6pan3Q3AW0Ymh_hKdosZEzin5vW0GmEeXr7WYkyxw Jul 19 15:52:16.937725 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Domain-Id: None Jul 19 15:52:16.937725 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Domain-Name: None Jul 19 15:52:16.937725 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Identity-Status: Confirmed Jul 19 15:52:16.937725 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Is-Admin-Project: True Jul 19 15:52:16.937725 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Project-Domain-Id: default Jul 19 15:52:16.937725 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Project-Domain-Name: Default Jul 19 15:52:16.937725 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Project-Id: e11e234f713b40cd8772372c2316dd28 Jul 19 15:52:16.937725 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Project-Name: tempest-AttachVolumeTestJSON-1928423787 Jul 19 15:52:16.937725 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Role: member,reader Jul 19 15:52:16.937725 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Roles: member,reader Jul 19 15:52:16.939353 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_e11e234f713b40cd8772372c2316dd28", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/e11e234f713b40cd8772372c2316dd28"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/e11e234f713b40cd8772372c2316dd28"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/e11e234f713b40cd8772372c2316dd28"}]}] Jul 19 15:52:16.939353 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Tenant: tempest-AttachVolumeTestJSON-1928423787 Jul 19 15:52:16.939353 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Tenant-Id: e11e234f713b40cd8772372c2316dd28 Jul 19 15:52:16.939353 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1928423787 Jul 19 15:52:16.939353 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User: tempest-AttachVolumeTestJSON-1928423787-project Jul 19 15:52:16.939353 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User-Domain-Id: default Jul 19 15:52:16.939353 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User-Domain-Name: Default Jul 19 15:52:16.939353 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User-Id: d9c75043813844d79fd0764132dfe4dd Jul 19 15:52:16.939353 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User-Name: tempest-AttachVolumeTestJSON-1928423787-project Jul 19 15:52:16.939353 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: method: > Jul 19 15:52:16.939353 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: exception: Instance 343ae383-5bfd-4c70-8926-a800fcee3519 could not be found. Jul 19 15:52:16.939353 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: action_args: {'id': '343ae383-5bfd-4c70-8926-a800fcee3519'} Jul 19 15:52:16.940200 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:52:16.940200 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:52:16.940200 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 15:52:16.940200 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 15:52:16.940200 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 15:52:16.940200 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 15:52:16.940200 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 15:52:16.940200 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 15:52:16.940200 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 15:52:16.940200 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 15:52:16.940200 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 343ae383-5bfd-4c70-8926-a800fcee3519 could not be found. Jul 19 15:52:16.940200 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:52:16.940200 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:52:16.940200 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:52:16.940200 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:52:16.940200 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:52:16.940200 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:52:16.940200 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:52:16.940200 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:52:16.940200 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:52:16.942313 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:52:16.942313 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 15:52:16.942313 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 15:52:16.942313 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 15:52:16.942313 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 15:52:16.942313 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 15:52:16.942313 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 15:52:16.942313 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 15:52:16.942313 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 15:52:16.942313 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 343ae383-5bfd-4c70-8926-a800fcee3519 could not be found. Jul 19 15:52:16.942313 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:52:16.942313 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:52:16.942313 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:52:16.942313 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:52:16.942313 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:52:16.942313 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:52:16.942313 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:52:16.942313 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:52:16.942313 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 343ae383-5bfd-4c70-8926-a800fcee3519 could not be found. Jul 19 15:52:16.942313 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:52:16.943833 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-b4167128-d1eb-4026-a646-64ac3778d9ca tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Returning 404 to user: Instance 343ae383-5bfd-4c70-8926-a800fcee3519 could not be found. {{(pid=129520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:52:16.943833 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-b4167128-d1eb-4026-a646-64ac3778d9ca tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "DELETE /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519" status: 404 len: 111 microversion: 2.1 time: 0.031121 Jul 19 15:52:16.943833 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 490/925] 10.222.0.64 () {58 vars in 1238 bytes} [Tue Jul 19 15:52:16 2022] DELETE /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 15:52:16.948170 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-50103741-1882-4421-9142-1bb5ece68f7a tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:16.948780 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-50103741-1882-4421-9142-1bb5ece68f7a tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] [instance: 343ae383-5bfd-4c70-8926-a800fcee3519] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:52:16.955331 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-50103741-1882-4421-9142-1bb5ece68f7a tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:16.955784 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-50103741-1882-4421-9142-1bb5ece68f7a tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:16.956551 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-50103741-1882-4421-9142-1bb5ece68f7a tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:16.956988 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-50103741-1882-4421-9142-1bb5ece68f7a tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:16.969880 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.wsgi [None req-50103741-1882-4421-9142-1bb5ece68f7a tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] HTTP exception thrown: Instance 343ae383-5bfd-4c70-8926-a800fcee3519 could not be found. Jul 19 15:52:16.971441 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-50103741-1882-4421-9142-1bb5ece68f7a tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Request method failure captured: Jul 19 15:52:16.971441 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: request: GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519 HTTP/1.1 Jul 19 15:52:16.971441 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Accept: application/json Jul 19 15:52:16.971441 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Accept-Encoding: identity Jul 19 15:52:16.971441 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Connection: close Jul 19 15:52:16.971441 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Content-Length: 0 Jul 19 15:52:16.971441 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Content-Type: application/json Jul 19 15:52:16.971441 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Host: 10.222.0.64 Jul 19 15:52:16.971441 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Openstack-System-Scope: None Jul 19 15:52:16.971441 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: User-Agent: python-urllib3/1.26.9 Jul 19 15:52:16.971441 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Auth-Token: gAAAAABi1tHeLm_LCBzz_Bg1FiUDtORDWFTPGXbpVJ2F6BGM4Zy_92gr2D50Ra8q_u960WvBhCTil5fIiRYXEiS_zgjeLu0y-flWKNola3MXcZpujx3jZswBWC8yY0g6OsKKmKOHe7r4WW6pan3Q3AW0Ymh_hKdosZEzin5vW0GmEeXr7WYkyxw Jul 19 15:52:16.971441 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Domain-Id: None Jul 19 15:52:16.971441 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Domain-Name: None Jul 19 15:52:16.971441 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Identity-Status: Confirmed Jul 19 15:52:16.971441 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Is-Admin-Project: True Jul 19 15:52:16.971441 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Domain-Id: default Jul 19 15:52:16.971441 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Domain-Name: Default Jul 19 15:52:16.971441 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Id: e11e234f713b40cd8772372c2316dd28 Jul 19 15:52:16.971441 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Name: tempest-AttachVolumeTestJSON-1928423787 Jul 19 15:52:16.971441 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Role: member,reader Jul 19 15:52:16.971441 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Roles: member,reader Jul 19 15:52:16.973620 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_e11e234f713b40cd8772372c2316dd28", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/e11e234f713b40cd8772372c2316dd28"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/e11e234f713b40cd8772372c2316dd28"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/e11e234f713b40cd8772372c2316dd28"}]}] Jul 19 15:52:16.973620 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Tenant: tempest-AttachVolumeTestJSON-1928423787 Jul 19 15:52:16.973620 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Tenant-Id: e11e234f713b40cd8772372c2316dd28 Jul 19 15:52:16.973620 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1928423787 Jul 19 15:52:16.973620 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User: tempest-AttachVolumeTestJSON-1928423787-project Jul 19 15:52:16.973620 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Domain-Id: default Jul 19 15:52:16.973620 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Domain-Name: Default Jul 19 15:52:16.973620 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Id: d9c75043813844d79fd0764132dfe4dd Jul 19 15:52:16.973620 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Name: tempest-AttachVolumeTestJSON-1928423787-project Jul 19 15:52:16.973620 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: method: > Jul 19 15:52:16.973620 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: exception: Instance 343ae383-5bfd-4c70-8926-a800fcee3519 could not be found. Jul 19 15:52:16.973620 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: action_args: {'id': '343ae383-5bfd-4c70-8926-a800fcee3519'} Jul 19 15:52:16.974563 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:52:16.974563 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:52:16.974563 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 15:52:16.974563 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 15:52:16.974563 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 15:52:16.974563 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 15:52:16.974563 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 15:52:16.974563 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 15:52:16.974563 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 15:52:16.974563 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 15:52:16.974563 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 343ae383-5bfd-4c70-8926-a800fcee3519 could not be found. Jul 19 15:52:16.974563 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:52:16.974563 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:52:16.974563 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:52:16.974563 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:52:16.974563 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:52:16.974563 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:52:16.974563 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:52:16.974563 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:52:16.974563 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:52:16.976007 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:52:16.976007 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 15:52:16.976007 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 15:52:16.976007 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 15:52:16.976007 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 15:52:16.976007 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 15:52:16.976007 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 15:52:16.976007 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 343ae383-5bfd-4c70-8926-a800fcee3519 could not be found. Jul 19 15:52:16.976007 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:52:16.976007 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:52:16.976007 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:52:16.976007 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:52:16.976007 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:52:16.976007 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:52:16.976007 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:52:16.976007 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:52:16.976007 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 343ae383-5bfd-4c70-8926-a800fcee3519 could not be found. Jul 19 15:52:16.976007 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:52:16.977292 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-50103741-1882-4421-9142-1bb5ece68f7a tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] Returning 404 to user: Instance 343ae383-5bfd-4c70-8926-a800fcee3519 could not be found. {{(pid=129519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:52:16.977292 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-50103741-1882-4421-9142-1bb5ece68f7a tempest-AttachVolumeTestJSON-1928423787 tempest-AttachVolumeTestJSON-1928423787-project] 10.222.0.64 "GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519" status: 404 len: 111 microversion: 2.1 time: 0.028937 Jul 19 15:52:16.977292 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 436/926] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:52:16 2022] GET /compute/v2.1/servers/343ae383-5bfd-4c70-8926-a800fcee3519 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 15:52:21.431322 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-3a261a37-1d77-4a49-ad68-d2f4f19bb3d9 tempest-VolumesSnapshotsTestJSON-1481073333 tempest-VolumesSnapshotsTestJSON-1481073333-project] Action: 'create', calling method: .version_select at 0x7fb8a5a72b80>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1752327296"}} {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:52:21.733272 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-3a261a37-1d77-4a49-ad68-d2f4f19bb3d9 tempest-VolumesSnapshotsTestJSON-1481073333 tempest-VolumesSnapshotsTestJSON-1481073333-project] 10.222.0.64 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.415958 Jul 19 15:52:21.733959 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 491/927] 10.222.0.64 () {60 vars in 1154 bytes} [Tue Jul 19 15:52:21 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 418 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Jul 19 15:52:21.745310 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-2bf7a2fa-d30a-485a-96d5-efda24d6b9d9 tempest-VolumesSnapshotsTestJSON-1481073333 tempest-VolumesSnapshotsTestJSON-1481073333-project] Calling method '.version_select at 0x7fb8a59cfc10>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:21.800589 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-2bf7a2fa-d30a-485a-96d5-efda24d6b9d9 tempest-VolumesSnapshotsTestJSON-1481073333 tempest-VolumesSnapshotsTestJSON-1481073333-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/1717db45-5100-4fa6-a806-3763bb990e59" status: 200 len: 345 microversion: 2.1 time: 0.058840 Jul 19 15:52:21.801151 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 437/928] 10.222.0.64 () {58 vars in 1244 bytes} [Tue Jul 19 15:52:21 2022] GET /compute/v2.1/os-volumes/1717db45-5100-4fa6-a806-3763bb990e59 => generated 345 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:52:22.813615 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-1231b40a-3f34-4e92-b195-e21d0a3fc537 tempest-VolumesSnapshotsTestJSON-1481073333 tempest-VolumesSnapshotsTestJSON-1481073333-project] Calling method '.version_select at 0x7fb8a5ab8ca0>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:22.860433 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-1231b40a-3f34-4e92-b195-e21d0a3fc537 tempest-VolumesSnapshotsTestJSON-1481073333 tempest-VolumesSnapshotsTestJSON-1481073333-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/1717db45-5100-4fa6-a806-3763bb990e59" status: 200 len: 346 microversion: 2.1 time: 0.051147 Jul 19 15:52:22.860982 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 492/929] 10.222.0.64 () {58 vars in 1244 bytes} [Tue Jul 19 15:52:22 2022] GET /compute/v2.1/os-volumes/1717db45-5100-4fa6-a806-3763bb990e59 => generated 346 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:52:22.872425 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-bb3b5b06-ba94-4f4b-b4d4-25925e62a40c tempest-VolumesSnapshotsTestJSON-1481073333 tempest-VolumesSnapshotsTestJSON-1481073333-project] Action: 'create', calling method: .version_select at 0x7fb8a5b56940>, body: {"snapshot": {"volume_id": "1717db45-5100-4fa6-a806-3763bb990e59", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-45800497"}} {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:52:23.019798 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-bb3b5b06-ba94-4f4b-b4d4-25925e62a40c tempest-VolumesSnapshotsTestJSON-1481073333 tempest-VolumesSnapshotsTestJSON-1481073333-project] 10.222.0.64 "POST /compute/v2.1/os-snapshots" status: 200 len: 285 microversion: 2.1 time: 0.151318 Jul 19 15:52:23.020378 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 438/930] 10.222.0.64 () {60 vars in 1161 bytes} [Tue Jul 19 15:52:22 2022] POST /compute/v2.1/os-snapshots => generated 285 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:52:23.031498 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-12cd1eef-64e9-49a7-90a1-bcd4e5092104 tempest-VolumesSnapshotsTestJSON-1481073333 tempest-VolumesSnapshotsTestJSON-1481073333-project] Calling method '.version_select at 0x7fb8a5b9d820>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:23.066704 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-12cd1eef-64e9-49a7-90a1-bcd4e5092104 tempest-VolumesSnapshotsTestJSON-1481073333 tempest-VolumesSnapshotsTestJSON-1481073333-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/3d3e3b36-2ff5-4896-9d39-b732544a2270" status: 200 len: 285 microversion: 2.1 time: 0.039768 Jul 19 15:52:23.067681 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 493/931] 10.222.0.64 () {58 vars in 1250 bytes} [Tue Jul 19 15:52:23 2022] GET /compute/v2.1/os-snapshots/3d3e3b36-2ff5-4896-9d39-b732544a2270 => generated 285 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:52:23.077175 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-1071997f-e99d-4db7-937c-f9063aa1bd7e tempest-VolumesSnapshotsTestJSON-1481073333 tempest-VolumesSnapshotsTestJSON-1481073333-project] Calling method '.version_select at 0x7fb8a5abe820>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:23.106483 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-1071997f-e99d-4db7-937c-f9063aa1bd7e tempest-VolumesSnapshotsTestJSON-1481073333 tempest-VolumesSnapshotsTestJSON-1481073333-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots" status: 200 len: 288 microversion: 2.1 time: 0.033142 Jul 19 15:52:23.107062 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 439/932] 10.222.0.64 () {58 vars in 1139 bytes} [Tue Jul 19 15:52:23 2022] GET /compute/v2.1/os-snapshots => generated 288 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:52:23.117804 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-ab6ea516-19b3-40cd-97a4-6be3624ce05b tempest-VolumesSnapshotsTestJSON-1481073333 tempest-VolumesSnapshotsTestJSON-1481073333-project] Calling method '.version_select at 0x7fb8a67bf160>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:23.147082 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-ab6ea516-19b3-40cd-97a4-6be3624ce05b tempest-VolumesSnapshotsTestJSON-1481073333 tempest-VolumesSnapshotsTestJSON-1481073333-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/3d3e3b36-2ff5-4896-9d39-b732544a2270" status: 200 len: 285 microversion: 2.1 time: 0.033174 Jul 19 15:52:23.147642 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 494/933] 10.222.0.64 () {58 vars in 1250 bytes} [Tue Jul 19 15:52:23 2022] GET /compute/v2.1/os-snapshots/3d3e3b36-2ff5-4896-9d39-b732544a2270 => generated 285 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:52:23.276710 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-9f15d2ef-8236-4864-91c0-410e8b5e23e8 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:23.277222 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-9f15d2ef-8236-4864-91c0-410e8b5e23e8 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: ef0f43ac-fd71-43ae-9213-9c3ab5f59161] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:52:23.283406 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-9f15d2ef-8236-4864-91c0-410e8b5e23e8 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:23.283850 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-9f15d2ef-8236-4864-91c0-410e8b5e23e8 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:23.285411 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-9f15d2ef-8236-4864-91c0-410e8b5e23e8 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:23.286098 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-9f15d2ef-8236-4864-91c0-410e8b5e23e8 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:23.366177 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.objects.instance [None req-9f15d2ef-8236-4864-91c0-410e8b5e23e8 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lazy-loading 'services' on Instance uuid ef0f43ac-fd71-43ae-9213-9c3ab5f59161 {{(pid=129519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 15:52:23.438046 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-9f15d2ef-8236-4864-91c0-410e8b5e23e8 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "DELETE /compute/v2.1/servers/ef0f43ac-fd71-43ae-9213-9c3ab5f59161/os-volume_attachments/430d4314-3841-4ba1-8987-ba79c39806ee" status: 202 len: 0 microversion: 2.1 time: 0.165165 Jul 19 15:52:23.438659 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 440/934] 10.222.0.64 () {58 vars in 1415 bytes} [Tue Jul 19 15:52:23 2022] DELETE /compute/v2.1/servers/ef0f43ac-fd71-43ae-9213-9c3ab5f59161/os-volume_attachments/430d4314-3841-4ba1-8987-ba79c39806ee => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 19 15:52:23.447311 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-e9e26033-1164-4665-86f2-e4c9e72f27ef tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:23.448287 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-e9e26033-1164-4665-86f2-e4c9e72f27ef tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: ef0f43ac-fd71-43ae-9213-9c3ab5f59161] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:52:23.454400 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-e9e26033-1164-4665-86f2-e4c9e72f27ef tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:23.454918 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-e9e26033-1164-4665-86f2-e4c9e72f27ef tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:23.455739 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-e9e26033-1164-4665-86f2-e4c9e72f27ef tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:23.456818 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-e9e26033-1164-4665-86f2-e4c9e72f27ef tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:23.487354 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-e9e26033-1164-4665-86f2-e4c9e72f27ef tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/ef0f43ac-fd71-43ae-9213-9c3ab5f59161/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043869 Jul 19 15:52:23.487882 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 495/935] 10.222.0.64 () {58 vars in 1301 bytes} [Tue Jul 19 15:52:23 2022] GET /compute/v2.1/servers/ef0f43ac-fd71-43ae-9213-9c3ab5f59161/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:52:24.159748 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-6977e3a3-7002-4e43-aab4-cfe3ed145845 tempest-VolumesSnapshotsTestJSON-1481073333 tempest-VolumesSnapshotsTestJSON-1481073333-project] Calling method '.version_select at 0x7fb8a59cf280>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:24.195120 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-6977e3a3-7002-4e43-aab4-cfe3ed145845 tempest-VolumesSnapshotsTestJSON-1481073333 tempest-VolumesSnapshotsTestJSON-1481073333-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/3d3e3b36-2ff5-4896-9d39-b732544a2270" status: 200 len: 285 microversion: 2.1 time: 0.040000 Jul 19 15:52:24.195674 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 441/936] 10.222.0.64 () {58 vars in 1250 bytes} [Tue Jul 19 15:52:24 2022] GET /compute/v2.1/os-snapshots/3d3e3b36-2ff5-4896-9d39-b732544a2270 => generated 285 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:52:24.499152 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-0a540c96-75ae-4765-a9bb-d0aeede4cc52 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:24.499984 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-0a540c96-75ae-4765-a9bb-d0aeede4cc52 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: ef0f43ac-fd71-43ae-9213-9c3ab5f59161] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:52:24.506801 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-0a540c96-75ae-4765-a9bb-d0aeede4cc52 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:24.507249 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-0a540c96-75ae-4765-a9bb-d0aeede4cc52 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:24.508037 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-0a540c96-75ae-4765-a9bb-d0aeede4cc52 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:24.508475 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-0a540c96-75ae-4765-a9bb-d0aeede4cc52 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:24.537372 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-0a540c96-75ae-4765-a9bb-d0aeede4cc52 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/ef0f43ac-fd71-43ae-9213-9c3ab5f59161/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042319 Jul 19 15:52:24.537929 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 496/937] 10.222.0.64 () {58 vars in 1301 bytes} [Tue Jul 19 15:52:24 2022] GET /compute/v2.1/servers/ef0f43ac-fd71-43ae-9213-9c3ab5f59161/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:52:25.207820 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-0ccd4e94-c50f-4af0-b8ab-405af3bca5d8 tempest-VolumesSnapshotsTestJSON-1481073333 tempest-VolumesSnapshotsTestJSON-1481073333-project] Calling method '.version_select at 0x7fb8a5b560d0>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:25.237032 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-0ccd4e94-c50f-4af0-b8ab-405af3bca5d8 tempest-VolumesSnapshotsTestJSON-1481073333 tempest-VolumesSnapshotsTestJSON-1481073333-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/3d3e3b36-2ff5-4896-9d39-b732544a2270" status: 200 len: 285 microversion: 2.1 time: 0.033681 Jul 19 15:52:25.238228 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 442/938] 10.222.0.64 () {58 vars in 1250 bytes} [Tue Jul 19 15:52:25 2022] GET /compute/v2.1/os-snapshots/3d3e3b36-2ff5-4896-9d39-b732544a2270 => generated 285 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:52:25.549365 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-f3302eb2-9eb7-480a-9e1a-5bf29c7e8d2c tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:25.550299 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-f3302eb2-9eb7-480a-9e1a-5bf29c7e8d2c tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: ef0f43ac-fd71-43ae-9213-9c3ab5f59161] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:52:25.557092 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-f3302eb2-9eb7-480a-9e1a-5bf29c7e8d2c tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:25.557536 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-f3302eb2-9eb7-480a-9e1a-5bf29c7e8d2c tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:25.558296 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-f3302eb2-9eb7-480a-9e1a-5bf29c7e8d2c tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:25.558830 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-f3302eb2-9eb7-480a-9e1a-5bf29c7e8d2c tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:25.588831 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-f3302eb2-9eb7-480a-9e1a-5bf29c7e8d2c tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/ef0f43ac-fd71-43ae-9213-9c3ab5f59161/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043529 Jul 19 15:52:25.589395 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 497/939] 10.222.0.64 () {58 vars in 1301 bytes} [Tue Jul 19 15:52:25 2022] GET /compute/v2.1/servers/ef0f43ac-fd71-43ae-9213-9c3ab5f59161/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:52:25.993416 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-943bbba7-1dd6-45de-9b89-5c357206b5df tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:25.994977 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-943bbba7-1dd6-45de-9b89-5c357206b5df tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: df3309b1-ba0f-4f40-937f-fc95c9c8f6a0] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:52:26.001139 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-943bbba7-1dd6-45de-9b89-5c357206b5df tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:26.001588 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-943bbba7-1dd6-45de-9b89-5c357206b5df tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:26.002344 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-943bbba7-1dd6-45de-9b89-5c357206b5df tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:26.002806 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-943bbba7-1dd6-45de-9b89-5c357206b5df tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:26.032372 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-943bbba7-1dd6-45de-9b89-5c357206b5df tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042938 Jul 19 15:52:26.032912 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 443/940] 10.222.0.64 () {60 vars in 1342 bytes} [Tue Jul 19 15:52:25 2022] GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:52:26.092190 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-9ee53230-9d78-4139-9bdd-421976ad5672 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:26.092689 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-9ee53230-9d78-4139-9bdd-421976ad5672 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: df3309b1-ba0f-4f40-937f-fc95c9c8f6a0] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:52:26.099454 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-9ee53230-9d78-4139-9bdd-421976ad5672 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:26.099908 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-9ee53230-9d78-4139-9bdd-421976ad5672 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:26.100664 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-9ee53230-9d78-4139-9bdd-421976ad5672 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:26.101098 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-9ee53230-9d78-4139-9bdd-421976ad5672 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:26.125806 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-9ee53230-9d78-4139-9bdd-421976ad5672 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: df3309b1-ba0f-4f40-937f-fc95c9c8f6a0] Going to try to terminate instance {{(pid=129520) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 15:52:26.199567 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-9ee53230-9d78-4139-9bdd-421976ad5672 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "DELETE /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0" status: 204 len: 0 microversion: 2.20 time: 0.110947 Jul 19 15:52:26.200202 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 498/941] 10.222.0.64 () {60 vars in 1279 bytes} [Tue Jul 19 15:52:26 2022] DELETE /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 19 15:52:26.208949 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-f3e9e587-df05-44e2-aef5-808efa3742f5 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:26.209640 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-f3e9e587-df05-44e2-aef5-808efa3742f5 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: df3309b1-ba0f-4f40-937f-fc95c9c8f6a0] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:52:26.217941 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-f3e9e587-df05-44e2-aef5-808efa3742f5 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:26.218798 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-f3e9e587-df05-44e2-aef5-808efa3742f5 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:26.220193 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-f3e9e587-df05-44e2-aef5-808efa3742f5 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:26.220705 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-f3e9e587-df05-44e2-aef5-808efa3742f5 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:26.249788 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-d773b9e0-698e-4564-9e32-8a36334de081 tempest-VolumesSnapshotsTestJSON-1481073333 tempest-VolumesSnapshotsTestJSON-1481073333-project] Calling method '.version_select at 0x7fb8a5ab80d0>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:26.279628 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-d773b9e0-698e-4564-9e32-8a36334de081 tempest-VolumesSnapshotsTestJSON-1481073333 tempest-VolumesSnapshotsTestJSON-1481073333-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/3d3e3b36-2ff5-4896-9d39-b732544a2270" status: 200 len: 286 microversion: 2.1 time: 0.034135 Jul 19 15:52:26.280191 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 499/942] 10.222.0.64 () {58 vars in 1250 bytes} [Tue Jul 19 15:52:26 2022] GET /compute/v2.1/os-snapshots/3d3e3b36-2ff5-4896-9d39-b732544a2270 => generated 286 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 15:52:26.290775 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-7a2fc6ec-8ab2-49fd-8c49-d8782e811bbc tempest-VolumesSnapshotsTestJSON-1481073333 tempest-VolumesSnapshotsTestJSON-1481073333-project] Calling method '.version_select at 0x7fb8a5c028b0>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:26.351584 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-7a2fc6ec-8ab2-49fd-8c49-d8782e811bbc tempest-VolumesSnapshotsTestJSON-1481073333 tempest-VolumesSnapshotsTestJSON-1481073333-project] 10.222.0.64 "DELETE /compute/v2.1/os-snapshots/3d3e3b36-2ff5-4896-9d39-b732544a2270" status: 202 len: 0 microversion: 2.1 time: 0.064484 Jul 19 15:52:26.352154 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 500/943] 10.222.0.64 () {58 vars in 1253 bytes} [Tue Jul 19 15:52:26 2022] DELETE /compute/v2.1/os-snapshots/3d3e3b36-2ff5-4896-9d39-b732544a2270 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 19 15:52:26.357603 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-f3e9e587-df05-44e2-aef5-808efa3742f5 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:52:26.364035 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-167850b0-5f6b-41db-be4e-9fbe65ca344f tempest-VolumesSnapshotsTestJSON-1481073333 tempest-VolumesSnapshotsTestJSON-1481073333-project] Calling method '.version_select at 0x7fb8a5aa71f0>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:26.366678 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-f3e9e587-df05-44e2-aef5-808efa3742f5 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:52:26.368179 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-f3e9e587-df05-44e2-aef5-808efa3742f5 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:52:26.369329 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-f3e9e587-df05-44e2-aef5-808efa3742f5 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0" status: 200 len: 1725 microversion: 2.20 time: 0.164904 Jul 19 15:52:26.369885 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 444/944] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:52:26 2022] GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0 => generated 1725 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 19 15:52:26.399373 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-167850b0-5f6b-41db-be4e-9fbe65ca344f tempest-VolumesSnapshotsTestJSON-1481073333 tempest-VolumesSnapshotsTestJSON-1481073333-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/3d3e3b36-2ff5-4896-9d39-b732544a2270" status: 200 len: 285 microversion: 2.1 time: 0.039837 Jul 19 15:52:26.399932 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 501/945] 10.222.0.64 () {58 vars in 1250 bytes} [Tue Jul 19 15:52:26 2022] GET /compute/v2.1/os-snapshots/3d3e3b36-2ff5-4896-9d39-b732544a2270 => generated 285 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:52:26.601290 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-1a13b945-972a-4f6a-a984-5d68de6a1573 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:26.602174 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-1a13b945-972a-4f6a-a984-5d68de6a1573 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: ef0f43ac-fd71-43ae-9213-9c3ab5f59161] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:52:26.608195 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-1a13b945-972a-4f6a-a984-5d68de6a1573 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:26.608638 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-1a13b945-972a-4f6a-a984-5d68de6a1573 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:26.609386 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-1a13b945-972a-4f6a-a984-5d68de6a1573 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:26.609817 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-1a13b945-972a-4f6a-a984-5d68de6a1573 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:26.637839 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-1a13b945-972a-4f6a-a984-5d68de6a1573 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/ef0f43ac-fd71-43ae-9213-9c3ab5f59161/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041339 Jul 19 15:52:26.638396 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 445/946] 10.222.0.64 () {58 vars in 1301 bytes} [Tue Jul 19 15:52:26 2022] GET /compute/v2.1/servers/ef0f43ac-fd71-43ae-9213-9c3ab5f59161/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:52:27.389399 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-241ff393-8f7b-46e1-9ac6-c65d45a4d9d3 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:27.390254 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-241ff393-8f7b-46e1-9ac6-c65d45a4d9d3 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: df3309b1-ba0f-4f40-937f-fc95c9c8f6a0] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:52:27.392329 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG dbcounter [-] [129520] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=129520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:52:27.398886 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-241ff393-8f7b-46e1-9ac6-c65d45a4d9d3 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:27.399371 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-241ff393-8f7b-46e1-9ac6-c65d45a4d9d3 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:27.400147 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-241ff393-8f7b-46e1-9ac6-c65d45a4d9d3 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:27.400586 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-241ff393-8f7b-46e1-9ac6-c65d45a4d9d3 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:27.411445 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-59235910-0970-4e8c-b7e0-c6f606cfe621 tempest-VolumesSnapshotsTestJSON-1481073333 tempest-VolumesSnapshotsTestJSON-1481073333-project] Calling method '.version_select at 0x7fb8a5a82f70>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:27.439150 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.wsgi [None req-59235910-0970-4e8c-b7e0-c6f606cfe621 tempest-VolumesSnapshotsTestJSON-1481073333 tempest-VolumesSnapshotsTestJSON-1481073333-project] HTTP exception thrown: Snapshot 3d3e3b36-2ff5-4896-9d39-b732544a2270 could not be found. Jul 19 15:52:27.442461 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-59235910-0970-4e8c-b7e0-c6f606cfe621 tempest-VolumesSnapshotsTestJSON-1481073333 tempest-VolumesSnapshotsTestJSON-1481073333-project] Request method failure captured: Jul 19 15:52:27.442461 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: request: GET /compute/v2.1/os-snapshots/3d3e3b36-2ff5-4896-9d39-b732544a2270 HTTP/1.1 Jul 19 15:52:27.442461 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Accept: application/json Jul 19 15:52:27.442461 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Accept-Encoding: identity Jul 19 15:52:27.442461 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Connection: close Jul 19 15:52:27.442461 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Content-Length: 0 Jul 19 15:52:27.442461 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Content-Type: application/json Jul 19 15:52:27.442461 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Host: 10.222.0.64 Jul 19 15:52:27.442461 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Openstack-System-Scope: None Jul 19 15:52:27.442461 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: User-Agent: python-urllib3/1.26.9 Jul 19 15:52:27.442461 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Auth-Token: gAAAAABi1tM1ir1J-hk87NLsMhevI7NElxvo5tNgLxHXEslgWam0ypg7arFF7COUJjsEAgZMMuWOAl_caiq48CPuO7UbQgAB-M2qRAAEdwjBRuynQvLBVlud-2e3bR3L2NXS9MHUD0Gl2o9fkdAPwCMfi1P3mhTrLgPeciJN0H5mruonZXY9t9Q Jul 19 15:52:27.442461 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Domain-Id: None Jul 19 15:52:27.442461 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Domain-Name: None Jul 19 15:52:27.442461 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Identity-Status: Confirmed Jul 19 15:52:27.442461 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Is-Admin-Project: True Jul 19 15:52:27.442461 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Domain-Id: default Jul 19 15:52:27.442461 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Domain-Name: Default Jul 19 15:52:27.442461 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Id: 104e846fd50c4aa18b43097f86270d8c Jul 19 15:52:27.442461 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1481073333 Jul 19 15:52:27.442461 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Role: member,reader Jul 19 15:52:27.442461 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Roles: member,reader Jul 19 15:52:27.443885 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_104e846fd50c4aa18b43097f86270d8c", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/104e846fd50c4aa18b43097f86270d8c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/104e846fd50c4aa18b43097f86270d8c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/104e846fd50c4aa18b43097f86270d8c"}]}] Jul 19 15:52:27.443885 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1481073333 Jul 19 15:52:27.443885 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Tenant-Id: 104e846fd50c4aa18b43097f86270d8c Jul 19 15:52:27.443885 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1481073333 Jul 19 15:52:27.443885 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User: tempest-VolumesSnapshotsTestJSON-1481073333-project Jul 19 15:52:27.443885 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Domain-Id: default Jul 19 15:52:27.443885 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Domain-Name: Default Jul 19 15:52:27.443885 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Id: 07738eb01d254841ac0c8ac011e45a10 Jul 19 15:52:27.443885 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1481073333-project Jul 19 15:52:27.443885 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: method: Jul 19 15:52:27.443885 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: exception: Snapshot 3d3e3b36-2ff5-4896-9d39-b732544a2270 could not be found. Jul 19 15:52:27.443885 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: action_args: {'id': '3d3e3b36-2ff5-4896-9d39-b732544a2270'} Jul 19 15:52:27.443885 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:52:27.444731 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:52:27.444731 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 19 15:52:27.444731 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 19 15:52:27.444731 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 19 15:52:27.444731 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 19 15:52:27.444731 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 19 15:52:27.444731 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 19 15:52:27.444731 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 19 15:52:27.444731 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 19 15:52:27.444731 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 19 15:52:27.444731 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 19 15:52:27.444731 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 15:52:27.444731 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 15:52:27.444731 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 15:52:27.444731 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 15:52:27.444731 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 3d3e3b36-2ff5-4896-9d39-b732544a2270 could not be found. (HTTP 404) (Request-ID: req-04b99c9a-a59e-4565-91b5-06e315b9c8a7) Jul 19 15:52:27.444731 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:52:27.444731 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:52:27.446154 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:52:27.446154 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:52:27.446154 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 19 15:52:27.446154 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 19 15:52:27.446154 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 19 15:52:27.446154 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 19 15:52:27.446154 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 19 15:52:27.446154 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 19 15:52:27.446154 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 19 15:52:27.446154 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 19 15:52:27.446154 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 19 15:52:27.446154 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 19 15:52:27.446154 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 19 15:52:27.446154 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 19 15:52:27.446154 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 19 15:52:27.446154 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 19 15:52:27.446154 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 19 15:52:27.446154 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 19 15:52:27.446154 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 19 15:52:27.447827 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 19 15:52:27.447827 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 15:52:27.447827 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 15:52:27.447827 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 15:52:27.447827 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 15:52:27.447827 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 3d3e3b36-2ff5-4896-9d39-b732544a2270 could not be found. Jul 19 15:52:27.447827 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:52:27.447827 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:52:27.447827 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:52:27.447827 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:52:27.447827 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:52:27.447827 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:52:27.447827 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:52:27.447827 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:52:27.447827 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 15:52:27.447827 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 15:52:27.447827 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:52:27.447827 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:52:27.447827 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 19 15:52:27.447827 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 15:52:27.449570 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 3d3e3b36-2ff5-4896-9d39-b732544a2270 could not be found. Jul 19 15:52:27.449570 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:52:27.449570 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:52:27.449570 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:52:27.449570 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:52:27.449570 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:52:27.449570 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:52:27.449570 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:52:27.449570 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:52:27.449570 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 3d3e3b36-2ff5-4896-9d39-b732544a2270 could not be found. Jul 19 15:52:27.449570 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:52:27.449570 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-59235910-0970-4e8c-b7e0-c6f606cfe621 tempest-VolumesSnapshotsTestJSON-1481073333 tempest-VolumesSnapshotsTestJSON-1481073333-project] Returning 404 to user: Snapshot 3d3e3b36-2ff5-4896-9d39-b732544a2270 could not be found. {{(pid=129519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:52:27.449570 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-59235910-0970-4e8c-b7e0-c6f606cfe621 tempest-VolumesSnapshotsTestJSON-1481073333 tempest-VolumesSnapshotsTestJSON-1481073333-project] 10.222.0.64 "GET /compute/v2.1/os-snapshots/3d3e3b36-2ff5-4896-9d39-b732544a2270" status: 404 len: 111 microversion: 2.1 time: 0.036838 Jul 19 15:52:27.450595 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 446/947] 10.222.0.64 () {58 vars in 1250 bytes} [Tue Jul 19 15:52:27 2022] GET /compute/v2.1/os-snapshots/3d3e3b36-2ff5-4896-9d39-b732544a2270 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 15:52:27.454301 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-75dbf541-6551-4d9c-9170-2bbd1f96f71a tempest-VolumesSnapshotsTestJSON-1481073333 tempest-VolumesSnapshotsTestJSON-1481073333-project] Calling method '.version_select at 0x7fb8a5b56dc0>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:27.517229 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-75dbf541-6551-4d9c-9170-2bbd1f96f71a tempest-VolumesSnapshotsTestJSON-1481073333 tempest-VolumesSnapshotsTestJSON-1481073333-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/1717db45-5100-4fa6-a806-3763bb990e59" status: 202 len: 0 microversion: 2.1 time: 0.068609 Jul 19 15:52:27.517804 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 447/948] 10.222.0.64 () {58 vars in 1247 bytes} [Tue Jul 19 15:52:27 2022] DELETE /compute/v2.1/os-volumes/1717db45-5100-4fa6-a806-3763bb990e59 => generated 0 bytes in 70 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 15:52:27.526692 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-a2640ed6-b95a-4dc6-b3d5-6afcdb91f6ec tempest-VolumesSnapshotsTestJSON-1481073333 tempest-VolumesSnapshotsTestJSON-1481073333-project] Calling method '.version_select at 0x7fb8a5a828b0>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:27.550660 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-241ff393-8f7b-46e1-9ac6-c65d45a4d9d3 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:52:27.560492 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-241ff393-8f7b-46e1-9ac6-c65d45a4d9d3 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:52:27.562060 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-241ff393-8f7b-46e1-9ac6-c65d45a4d9d3 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:52:27.563257 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-241ff393-8f7b-46e1-9ac6-c65d45a4d9d3 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0" status: 200 len: 1725 microversion: 2.20 time: 0.178267 Jul 19 15:52:27.563817 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 502/949] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:52:27 2022] GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0 => generated 1725 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:52:27.579169 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-a2640ed6-b95a-4dc6-b3d5-6afcdb91f6ec tempest-VolumesSnapshotsTestJSON-1481073333 tempest-VolumesSnapshotsTestJSON-1481073333-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/1717db45-5100-4fa6-a806-3763bb990e59" status: 200 len: 345 microversion: 2.1 time: 0.056483 Jul 19 15:52:27.579727 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 448/950] 10.222.0.64 () {58 vars in 1244 bytes} [Tue Jul 19 15:52:27 2022] GET /compute/v2.1/os-volumes/1717db45-5100-4fa6-a806-3763bb990e59 => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 15:52:27.649465 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-b90a365a-c3bf-4055-99bf-b453ed2e7f15 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:27.650421 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-b90a365a-c3bf-4055-99bf-b453ed2e7f15 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: ef0f43ac-fd71-43ae-9213-9c3ab5f59161] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:52:27.656556 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b90a365a-c3bf-4055-99bf-b453ed2e7f15 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:27.657002 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b90a365a-c3bf-4055-99bf-b453ed2e7f15 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:27.657766 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b90a365a-c3bf-4055-99bf-b453ed2e7f15 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:27.658200 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b90a365a-c3bf-4055-99bf-b453ed2e7f15 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:27.689680 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-b90a365a-c3bf-4055-99bf-b453ed2e7f15 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/ef0f43ac-fd71-43ae-9213-9c3ab5f59161/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044362 Jul 19 15:52:27.690256 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 503/951] 10.222.0.64 () {58 vars in 1301 bytes} [Tue Jul 19 15:52:27 2022] GET /compute/v2.1/servers/ef0f43ac-fd71-43ae-9213-9c3ab5f59161/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:52:28.473962 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [req-a83b379a-b18f-40cf-8f56-458ee4587c86 req-5ac783b3-1153-4e45-a623-91fdf156722d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df3309b1-ba0f-4f40-937f-fc95c9c8f6a0", "name": "network-vif-deleted", "tag": "f79bc5b8-5b78-4990-ae5f-977bb42032bd"}]} {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:52:28.478772 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG dbcounter [-] [129519] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:52:28.483381 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [req-a83b379a-b18f-40cf-8f56-458ee4587c86 req-5ac783b3-1153-4e45-a623-91fdf156722d service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:28.483829 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [req-a83b379a-b18f-40cf-8f56-458ee4587c86 req-5ac783b3-1153-4e45-a623-91fdf156722d service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:28.496203 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.compute.server_external_events [req-a83b379a-b18f-40cf-8f56-458ee4587c86 req-5ac783b3-1153-4e45-a623-91fdf156722d service nova] Creating event network-vif-deleted:f79bc5b8-5b78-4990-ae5f-977bb42032bd for instance df3309b1-ba0f-4f40-937f-fc95c9c8f6a0 on hv-cinder-84902 Jul 19 15:52:28.501895 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [req-a83b379a-b18f-40cf-8f56-458ee4587c86 req-5ac783b3-1153-4e45-a623-91fdf156722d service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032502 Jul 19 15:52:28.502768 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 449/952] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Jul 19 15:52:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:52:28.583213 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-b2fdc940-0213-42ea-9359-377430fee7c2 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:28.583994 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-b2fdc940-0213-42ea-9359-377430fee7c2 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: df3309b1-ba0f-4f40-937f-fc95c9c8f6a0] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:52:28.593592 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-ed0710dd-63f2-4e79-aacf-28fc15c0986b tempest-VolumesSnapshotsTestJSON-1481073333 tempest-VolumesSnapshotsTestJSON-1481073333-project] Calling method '.version_select at 0x7fb8a5abe280>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:28.619135 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b2fdc940-0213-42ea-9359-377430fee7c2 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:28.619601 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b2fdc940-0213-42ea-9359-377430fee7c2 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:28.620606 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b2fdc940-0213-42ea-9359-377430fee7c2 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:28.621793 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b2fdc940-0213-42ea-9359-377430fee7c2 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:28.643042 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.wsgi [None req-ed0710dd-63f2-4e79-aacf-28fc15c0986b tempest-VolumesSnapshotsTestJSON-1481073333 tempest-VolumesSnapshotsTestJSON-1481073333-project] HTTP exception thrown: Volume 1717db45-5100-4fa6-a806-3763bb990e59 could not be found. Jul 19 15:52:28.645540 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-ed0710dd-63f2-4e79-aacf-28fc15c0986b tempest-VolumesSnapshotsTestJSON-1481073333 tempest-VolumesSnapshotsTestJSON-1481073333-project] Request method failure captured: Jul 19 15:52:28.645540 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: request: GET /compute/v2.1/os-volumes/1717db45-5100-4fa6-a806-3763bb990e59 HTTP/1.1 Jul 19 15:52:28.645540 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Accept: application/json Jul 19 15:52:28.645540 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Accept-Encoding: identity Jul 19 15:52:28.645540 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Connection: close Jul 19 15:52:28.645540 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Content-Length: 0 Jul 19 15:52:28.645540 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Content-Type: application/json Jul 19 15:52:28.645540 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Host: 10.222.0.64 Jul 19 15:52:28.645540 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Openstack-System-Scope: None Jul 19 15:52:28.645540 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: User-Agent: python-urllib3/1.26.9 Jul 19 15:52:28.645540 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Auth-Token: gAAAAABi1tM1ir1J-hk87NLsMhevI7NElxvo5tNgLxHXEslgWam0ypg7arFF7COUJjsEAgZMMuWOAl_caiq48CPuO7UbQgAB-M2qRAAEdwjBRuynQvLBVlud-2e3bR3L2NXS9MHUD0Gl2o9fkdAPwCMfi1P3mhTrLgPeciJN0H5mruonZXY9t9Q Jul 19 15:52:28.645540 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Domain-Id: None Jul 19 15:52:28.645540 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Domain-Name: None Jul 19 15:52:28.645540 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Identity-Status: Confirmed Jul 19 15:52:28.645540 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Is-Admin-Project: True Jul 19 15:52:28.645540 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Domain-Id: default Jul 19 15:52:28.645540 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Domain-Name: Default Jul 19 15:52:28.645540 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Id: 104e846fd50c4aa18b43097f86270d8c Jul 19 15:52:28.645540 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1481073333 Jul 19 15:52:28.645540 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Role: member,reader Jul 19 15:52:28.645540 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Roles: member,reader Jul 19 15:52:28.647249 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_104e846fd50c4aa18b43097f86270d8c", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/104e846fd50c4aa18b43097f86270d8c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/104e846fd50c4aa18b43097f86270d8c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/104e846fd50c4aa18b43097f86270d8c"}]}] Jul 19 15:52:28.647249 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1481073333 Jul 19 15:52:28.647249 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Tenant-Id: 104e846fd50c4aa18b43097f86270d8c Jul 19 15:52:28.647249 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1481073333 Jul 19 15:52:28.647249 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User: tempest-VolumesSnapshotsTestJSON-1481073333-project Jul 19 15:52:28.647249 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Domain-Id: default Jul 19 15:52:28.647249 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Domain-Name: Default Jul 19 15:52:28.647249 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Id: 07738eb01d254841ac0c8ac011e45a10 Jul 19 15:52:28.647249 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1481073333-project Jul 19 15:52:28.647249 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: method: Jul 19 15:52:28.647249 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: exception: Volume 1717db45-5100-4fa6-a806-3763bb990e59 could not be found. Jul 19 15:52:28.647249 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: action_args: {'id': '1717db45-5100-4fa6-a806-3763bb990e59'} Jul 19 15:52:28.647249 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:52:28.648052 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:52:28.648052 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 15:52:28.648052 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 15:52:28.648052 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 19 15:52:28.648052 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 19 15:52:28.648052 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 19 15:52:28.648052 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 19 15:52:28.648052 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 19 15:52:28.648052 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 19 15:52:28.648052 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 19 15:52:28.648052 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 19 15:52:28.648052 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 15:52:28.648052 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 15:52:28.648052 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 15:52:28.648052 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 15:52:28.648052 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1717db45-5100-4fa6-a806-3763bb990e59 could not be found. (HTTP 404) (Request-ID: req-e3bb9093-043a-48d0-9ba7-90a4626fc744) Jul 19 15:52:28.648052 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:52:28.648052 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:52:28.648052 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:52:28.649164 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:52:28.649164 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 19 15:52:28.649164 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 19 15:52:28.649164 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 19 15:52:28.649164 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 19 15:52:28.649164 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 19 15:52:28.649164 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 19 15:52:28.649164 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 19 15:52:28.649164 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 19 15:52:28.649164 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 15:52:28.649164 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 15:52:28.649164 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 19 15:52:28.649164 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 19 15:52:28.649164 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 19 15:52:28.649164 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 19 15:52:28.649164 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 19 15:52:28.649164 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 19 15:52:28.649164 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 19 15:52:28.649164 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 19 15:52:28.650257 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 15:52:28.650257 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 15:52:28.650257 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 15:52:28.650257 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 15:52:28.650257 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1717db45-5100-4fa6-a806-3763bb990e59 could not be found. Jul 19 15:52:28.650257 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:52:28.650257 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:52:28.650257 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:52:28.650257 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:52:28.650257 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:52:28.650257 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:52:28.650257 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:52:28.650257 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:52:28.650257 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 15:52:28.650257 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 15:52:28.650257 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:52:28.650257 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:52:28.650257 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 19 15:52:28.650257 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 15:52:28.651459 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1717db45-5100-4fa6-a806-3763bb990e59 could not be found. Jul 19 15:52:28.651459 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:52:28.651459 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:52:28.651459 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:52:28.651459 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:52:28.651459 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:52:28.651459 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:52:28.651459 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:52:28.651459 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:52:28.651459 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1717db45-5100-4fa6-a806-3763bb990e59 could not be found. Jul 19 15:52:28.651459 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:52:28.651459 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-ed0710dd-63f2-4e79-aacf-28fc15c0986b tempest-VolumesSnapshotsTestJSON-1481073333 tempest-VolumesSnapshotsTestJSON-1481073333-project] Returning 404 to user: Volume 1717db45-5100-4fa6-a806-3763bb990e59 could not be found. {{(pid=129519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:52:28.651459 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-ed0710dd-63f2-4e79-aacf-28fc15c0986b tempest-VolumesSnapshotsTestJSON-1481073333 tempest-VolumesSnapshotsTestJSON-1481073333-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/1717db45-5100-4fa6-a806-3763bb990e59" status: 404 len: 109 microversion: 2.1 time: 0.058352 Jul 19 15:52:28.656818 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 450/953] 10.222.0.64 () {58 vars in 1244 bytes} [Tue Jul 19 15:52:28 2022] GET /compute/v2.1/os-volumes/1717db45-5100-4fa6-a806-3763bb990e59 => generated 109 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 15:52:28.664368 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-38aa77a5-37a2-452d-982b-1117d70f4118 tempest-VolumesSnapshotsTestJSON-1481073333 tempest-VolumesSnapshotsTestJSON-1481073333-project] Calling method '.version_select at 0x7fb8a5a72670>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:28.703839 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b2fdc940-0213-42ea-9359-377430fee7c2 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:28.704679 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b2fdc940-0213-42ea-9359-377430fee7c2 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:28.705484 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.objects.instance [None req-b2fdc940-0213-42ea-9359-377430fee7c2 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lazy-loading 'fault' on Instance uuid df3309b1-ba0f-4f40-937f-fc95c9c8f6a0 {{(pid=129520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 15:52:28.727373 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.wsgi [None req-38aa77a5-37a2-452d-982b-1117d70f4118 tempest-VolumesSnapshotsTestJSON-1481073333 tempest-VolumesSnapshotsTestJSON-1481073333-project] HTTP exception thrown: Volume 1717db45-5100-4fa6-a806-3763bb990e59 could not be found. Jul 19 15:52:28.729600 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-38aa77a5-37a2-452d-982b-1117d70f4118 tempest-VolumesSnapshotsTestJSON-1481073333 tempest-VolumesSnapshotsTestJSON-1481073333-project] Request method failure captured: Jul 19 15:52:28.729600 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: request: DELETE /compute/v2.1/os-volumes/1717db45-5100-4fa6-a806-3763bb990e59 HTTP/1.1 Jul 19 15:52:28.729600 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Accept: application/json Jul 19 15:52:28.729600 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Accept-Encoding: identity Jul 19 15:52:28.729600 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Connection: close Jul 19 15:52:28.729600 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Content-Length: 0 Jul 19 15:52:28.729600 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Content-Type: application/json Jul 19 15:52:28.729600 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Host: 10.222.0.64 Jul 19 15:52:28.729600 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Openstack-System-Scope: None Jul 19 15:52:28.729600 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: User-Agent: python-urllib3/1.26.9 Jul 19 15:52:28.729600 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Auth-Token: gAAAAABi1tM1ir1J-hk87NLsMhevI7NElxvo5tNgLxHXEslgWam0ypg7arFF7COUJjsEAgZMMuWOAl_caiq48CPuO7UbQgAB-M2qRAAEdwjBRuynQvLBVlud-2e3bR3L2NXS9MHUD0Gl2o9fkdAPwCMfi1P3mhTrLgPeciJN0H5mruonZXY9t9Q Jul 19 15:52:28.729600 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Domain-Id: None Jul 19 15:52:28.729600 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Domain-Name: None Jul 19 15:52:28.729600 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Identity-Status: Confirmed Jul 19 15:52:28.729600 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Is-Admin-Project: True Jul 19 15:52:28.729600 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Domain-Id: default Jul 19 15:52:28.729600 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Domain-Name: Default Jul 19 15:52:28.729600 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Id: 104e846fd50c4aa18b43097f86270d8c Jul 19 15:52:28.729600 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1481073333 Jul 19 15:52:28.729600 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Role: member,reader Jul 19 15:52:28.729600 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Roles: member,reader Jul 19 15:52:28.730958 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_104e846fd50c4aa18b43097f86270d8c", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/104e846fd50c4aa18b43097f86270d8c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/104e846fd50c4aa18b43097f86270d8c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/104e846fd50c4aa18b43097f86270d8c"}]}] Jul 19 15:52:28.730958 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1481073333 Jul 19 15:52:28.730958 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Tenant-Id: 104e846fd50c4aa18b43097f86270d8c Jul 19 15:52:28.730958 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1481073333 Jul 19 15:52:28.730958 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User: tempest-VolumesSnapshotsTestJSON-1481073333-project Jul 19 15:52:28.730958 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Domain-Id: default Jul 19 15:52:28.730958 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Domain-Name: Default Jul 19 15:52:28.730958 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Id: 07738eb01d254841ac0c8ac011e45a10 Jul 19 15:52:28.730958 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1481073333-project Jul 19 15:52:28.730958 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: method: Jul 19 15:52:28.730958 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: exception: Volume 1717db45-5100-4fa6-a806-3763bb990e59 could not be found. Jul 19 15:52:28.730958 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: action_args: {'id': '1717db45-5100-4fa6-a806-3763bb990e59'} Jul 19 15:52:28.730958 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:52:28.731832 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:52:28.731832 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 15:52:28.731832 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 15:52:28.731832 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 19 15:52:28.731832 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 19 15:52:28.731832 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 19 15:52:28.731832 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 19 15:52:28.731832 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 19 15:52:28.731832 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 19 15:52:28.731832 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 19 15:52:28.731832 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 19 15:52:28.731832 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 15:52:28.731832 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 15:52:28.731832 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 15:52:28.731832 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 15:52:28.731832 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1717db45-5100-4fa6-a806-3763bb990e59 could not be found. (HTTP 404) (Request-ID: req-044f32c8-ee71-4983-9bc0-d29ae76ed537) Jul 19 15:52:28.731832 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:52:28.731832 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:52:28.731832 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:52:28.732994 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:52:28.732994 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 19 15:52:28.732994 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 19 15:52:28.732994 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 19 15:52:28.732994 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 19 15:52:28.732994 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 19 15:52:28.732994 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 19 15:52:28.732994 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 19 15:52:28.732994 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 19 15:52:28.732994 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 15:52:28.732994 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 15:52:28.732994 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 19 15:52:28.732994 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 19 15:52:28.732994 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 19 15:52:28.732994 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 19 15:52:28.732994 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 19 15:52:28.732994 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 19 15:52:28.732994 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 19 15:52:28.732994 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 19 15:52:28.734113 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 15:52:28.734113 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 15:52:28.734113 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 15:52:28.734113 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 15:52:28.734113 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1717db45-5100-4fa6-a806-3763bb990e59 could not be found. Jul 19 15:52:28.734113 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:52:28.734113 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:52:28.734113 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:52:28.734113 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:52:28.734113 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:52:28.734113 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:52:28.734113 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:52:28.734113 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:52:28.734113 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 15:52:28.734113 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 15:52:28.734113 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:52:28.734113 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:52:28.734113 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 19 15:52:28.734113 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 15:52:28.737268 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1717db45-5100-4fa6-a806-3763bb990e59 could not be found. Jul 19 15:52:28.737268 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:52:28.737268 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:52:28.737268 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:52:28.737268 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:52:28.737268 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:52:28.737268 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:52:28.737268 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:52:28.737268 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:52:28.737268 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1717db45-5100-4fa6-a806-3763bb990e59 could not be found. Jul 19 15:52:28.737268 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:52:28.737268 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-38aa77a5-37a2-452d-982b-1117d70f4118 tempest-VolumesSnapshotsTestJSON-1481073333 tempest-VolumesSnapshotsTestJSON-1481073333-project] Returning 404 to user: Volume 1717db45-5100-4fa6-a806-3763bb990e59 could not be found. {{(pid=129519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:52:28.737268 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-38aa77a5-37a2-452d-982b-1117d70f4118 tempest-VolumesSnapshotsTestJSON-1481073333 tempest-VolumesSnapshotsTestJSON-1481073333-project] 10.222.0.64 "DELETE /compute/v2.1/os-volumes/1717db45-5100-4fa6-a806-3763bb990e59" status: 404 len: 109 microversion: 2.1 time: 0.073134 Jul 19 15:52:28.737268 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 451/954] 10.222.0.64 () {58 vars in 1247 bytes} [Tue Jul 19 15:52:28 2022] DELETE /compute/v2.1/os-volumes/1717db45-5100-4fa6-a806-3763bb990e59 => generated 109 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 15:52:28.745308 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-05488152-e991-455e-96cf-ef96c9d324a7 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:28.750339 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-05488152-e991-455e-96cf-ef96c9d324a7 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: ef0f43ac-fd71-43ae-9213-9c3ab5f59161] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:52:28.768238 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-05488152-e991-455e-96cf-ef96c9d324a7 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:28.769486 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-05488152-e991-455e-96cf-ef96c9d324a7 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:28.770378 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-05488152-e991-455e-96cf-ef96c9d324a7 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:28.770850 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-05488152-e991-455e-96cf-ef96c9d324a7 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:28.782486 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-b2fdc940-0213-42ea-9359-377430fee7c2 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:52:28.793102 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-b2fdc940-0213-42ea-9359-377430fee7c2 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:52:28.799048 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-b2fdc940-0213-42ea-9359-377430fee7c2 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'fca86639f2d344be97cb1529dc17f62a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '171a2f5462994c8d98ffd8cbc2ce5677', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:52:28.800322 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-b2fdc940-0213-42ea-9359-377430fee7c2 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0" status: 200 len: 1372 microversion: 2.20 time: 0.223068 Jul 19 15:52:28.800885 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 504/955] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:52:28 2022] GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0 => generated 1372 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 19 15:52:28.824623 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-49906394-f57b-4aa1-b118-4bf9473391ca tempest-VolumesSnapshotsTestJSON-1481073333 tempest-VolumesSnapshotsTestJSON-1481073333-project] Calling method '.version_select at 0x7fb8a5bfc940>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:28.858190 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-05488152-e991-455e-96cf-ef96c9d324a7 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/ef0f43ac-fd71-43ae-9213-9c3ab5f59161/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.121673 Jul 19 15:52:28.860209 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 452/956] 10.222.0.64 () {58 vars in 1301 bytes} [Tue Jul 19 15:52:28 2022] GET /compute/v2.1/servers/ef0f43ac-fd71-43ae-9213-9c3ab5f59161/os-volume_attachments => generated 25 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 19 15:52:28.881902 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.wsgi [None req-49906394-f57b-4aa1-b118-4bf9473391ca tempest-VolumesSnapshotsTestJSON-1481073333 tempest-VolumesSnapshotsTestJSON-1481073333-project] HTTP exception thrown: Volume 1717db45-5100-4fa6-a806-3763bb990e59 could not be found. Jul 19 15:52:28.884238 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-49906394-f57b-4aa1-b118-4bf9473391ca tempest-VolumesSnapshotsTestJSON-1481073333 tempest-VolumesSnapshotsTestJSON-1481073333-project] Request method failure captured: Jul 19 15:52:28.884238 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: request: GET /compute/v2.1/os-volumes/1717db45-5100-4fa6-a806-3763bb990e59 HTTP/1.1 Jul 19 15:52:28.884238 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Accept: application/json Jul 19 15:52:28.884238 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Accept-Encoding: identity Jul 19 15:52:28.884238 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Connection: close Jul 19 15:52:28.884238 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Content-Length: 0 Jul 19 15:52:28.884238 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Content-Type: application/json Jul 19 15:52:28.884238 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Host: 10.222.0.64 Jul 19 15:52:28.884238 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Openstack-System-Scope: None Jul 19 15:52:28.884238 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: User-Agent: python-urllib3/1.26.9 Jul 19 15:52:28.884238 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Auth-Token: gAAAAABi1tM1ir1J-hk87NLsMhevI7NElxvo5tNgLxHXEslgWam0ypg7arFF7COUJjsEAgZMMuWOAl_caiq48CPuO7UbQgAB-M2qRAAEdwjBRuynQvLBVlud-2e3bR3L2NXS9MHUD0Gl2o9fkdAPwCMfi1P3mhTrLgPeciJN0H5mruonZXY9t9Q Jul 19 15:52:28.884238 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Domain-Id: None Jul 19 15:52:28.884238 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Domain-Name: None Jul 19 15:52:28.884238 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Identity-Status: Confirmed Jul 19 15:52:28.884238 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Is-Admin-Project: True Jul 19 15:52:28.884238 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Project-Domain-Id: default Jul 19 15:52:28.884238 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Project-Domain-Name: Default Jul 19 15:52:28.884238 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Project-Id: 104e846fd50c4aa18b43097f86270d8c Jul 19 15:52:28.884238 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1481073333 Jul 19 15:52:28.884238 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Role: member,reader Jul 19 15:52:28.884238 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Roles: member,reader Jul 19 15:52:28.885727 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_104e846fd50c4aa18b43097f86270d8c", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/104e846fd50c4aa18b43097f86270d8c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/104e846fd50c4aa18b43097f86270d8c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/104e846fd50c4aa18b43097f86270d8c"}]}] Jul 19 15:52:28.885727 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1481073333 Jul 19 15:52:28.885727 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Tenant-Id: 104e846fd50c4aa18b43097f86270d8c Jul 19 15:52:28.885727 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1481073333 Jul 19 15:52:28.885727 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User: tempest-VolumesSnapshotsTestJSON-1481073333-project Jul 19 15:52:28.885727 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User-Domain-Id: default Jul 19 15:52:28.885727 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User-Domain-Name: Default Jul 19 15:52:28.885727 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User-Id: 07738eb01d254841ac0c8ac011e45a10 Jul 19 15:52:28.885727 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1481073333-project Jul 19 15:52:28.885727 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: method: Jul 19 15:52:28.885727 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: exception: Volume 1717db45-5100-4fa6-a806-3763bb990e59 could not be found. Jul 19 15:52:28.885727 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: action_args: {'id': '1717db45-5100-4fa6-a806-3763bb990e59'} Jul 19 15:52:28.885727 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:52:28.886639 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:52:28.886639 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 15:52:28.886639 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 15:52:28.886639 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 19 15:52:28.886639 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 19 15:52:28.886639 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 19 15:52:28.886639 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 19 15:52:28.886639 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 19 15:52:28.886639 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 19 15:52:28.886639 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 19 15:52:28.886639 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 19 15:52:28.886639 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 15:52:28.886639 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 15:52:28.886639 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 15:52:28.886639 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 15:52:28.886639 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1717db45-5100-4fa6-a806-3763bb990e59 could not be found. (HTTP 404) (Request-ID: req-902c7d3f-b503-4909-9a32-1a507dfeec5e) Jul 19 15:52:28.886639 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:52:28.886639 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:52:28.886639 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:52:28.887904 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:52:28.887904 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 19 15:52:28.887904 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 19 15:52:28.887904 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 19 15:52:28.887904 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 19 15:52:28.887904 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 19 15:52:28.887904 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 19 15:52:28.887904 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 19 15:52:28.887904 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 19 15:52:28.887904 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 19 15:52:28.887904 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 19 15:52:28.887904 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 19 15:52:28.887904 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 19 15:52:28.887904 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 19 15:52:28.887904 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 19 15:52:28.887904 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 19 15:52:28.887904 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 19 15:52:28.887904 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 19 15:52:28.887904 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 19 15:52:28.889140 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 19 15:52:28.889140 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 19 15:52:28.889140 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 19 15:52:28.889140 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 19 15:52:28.889140 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1717db45-5100-4fa6-a806-3763bb990e59 could not be found. Jul 19 15:52:28.889140 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:52:28.889140 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:52:28.889140 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:52:28.889140 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:52:28.889140 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:52:28.889140 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:52:28.889140 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:52:28.889140 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:52:28.889140 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 19 15:52:28.889140 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 19 15:52:28.889140 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:52:28.889140 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:52:28.889140 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 19 15:52:28.889140 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 15:52:28.890714 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1717db45-5100-4fa6-a806-3763bb990e59 could not be found. Jul 19 15:52:28.890714 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:52:28.890714 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:52:28.890714 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:52:28.890714 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:52:28.890714 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:52:28.890714 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:52:28.890714 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:52:28.890714 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:52:28.890714 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1717db45-5100-4fa6-a806-3763bb990e59 could not be found. Jul 19 15:52:28.890714 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:52:28.892783 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-49906394-f57b-4aa1-b118-4bf9473391ca tempest-VolumesSnapshotsTestJSON-1481073333 tempest-VolumesSnapshotsTestJSON-1481073333-project] Returning 404 to user: Volume 1717db45-5100-4fa6-a806-3763bb990e59 could not be found. {{(pid=129520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:52:28.894602 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-49906394-f57b-4aa1-b118-4bf9473391ca tempest-VolumesSnapshotsTestJSON-1481073333 tempest-VolumesSnapshotsTestJSON-1481073333-project] 10.222.0.64 "GET /compute/v2.1/os-volumes/1717db45-5100-4fa6-a806-3763bb990e59" status: 404 len: 109 microversion: 2.1 time: 0.076522 Jul 19 15:52:28.895320 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 505/957] 10.222.0.64 () {58 vars in 1244 bytes} [Tue Jul 19 15:52:28 2022] GET /compute/v2.1/os-volumes/1717db45-5100-4fa6-a806-3763bb990e59 => generated 109 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 15:52:28.937947 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-38f6572e-96f0-4e60-b5ff-52d79380061f tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:28.938690 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-38f6572e-96f0-4e60-b5ff-52d79380061f tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: ef0f43ac-fd71-43ae-9213-9c3ab5f59161] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:52:28.962501 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-38f6572e-96f0-4e60-b5ff-52d79380061f tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:28.962987 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-38f6572e-96f0-4e60-b5ff-52d79380061f tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:28.963776 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-38f6572e-96f0-4e60-b5ff-52d79380061f tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:28.964213 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-38f6572e-96f0-4e60-b5ff-52d79380061f tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:29.012828 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-38f6572e-96f0-4e60-b5ff-52d79380061f tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: ef0f43ac-fd71-43ae-9213-9c3ab5f59161] Going to try to terminate instance {{(pid=129519) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 15:52:29.122119 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-38f6572e-96f0-4e60-b5ff-52d79380061f tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "DELETE /compute/v2.1/servers/ef0f43ac-fd71-43ae-9213-9c3ab5f59161" status: 204 len: 0 microversion: 2.1 time: 0.187703 Jul 19 15:52:29.122965 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 453/958] 10.222.0.64 () {58 vars in 1238 bytes} [Tue Jul 19 15:52:28 2022] DELETE /compute/v2.1/servers/ef0f43ac-fd71-43ae-9213-9c3ab5f59161 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 15:52:29.132398 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-db9bdc3e-0976-4b01-946e-82b289aa8915 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:29.133703 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-db9bdc3e-0976-4b01-946e-82b289aa8915 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: ef0f43ac-fd71-43ae-9213-9c3ab5f59161] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:52:29.141850 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-db9bdc3e-0976-4b01-946e-82b289aa8915 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:29.142658 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-db9bdc3e-0976-4b01-946e-82b289aa8915 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:29.143455 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-db9bdc3e-0976-4b01-946e-82b289aa8915 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:29.144278 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-db9bdc3e-0976-4b01-946e-82b289aa8915 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:29.282379 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-db9bdc3e-0976-4b01-946e-82b289aa8915 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7c42cf0bc84292bb0b7edb9f2e7fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a72d232f314a78b0e1c3f04b0ed682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:52:29.290657 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-db9bdc3e-0976-4b01-946e-82b289aa8915 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/ef0f43ac-fd71-43ae-9213-9c3ab5f59161" status: 200 len: 1680 microversion: 2.1 time: 0.162998 Jul 19 15:52:29.294433 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 506/959] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:52:29 2022] GET /compute/v2.1/servers/ef0f43ac-fd71-43ae-9213-9c3ab5f59161 => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:52:29.819118 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-7de21903-e4e1-4319-af7a-e2ae520e9243 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:29.819810 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-7de21903-e4e1-4319-af7a-e2ae520e9243 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: df3309b1-ba0f-4f40-937f-fc95c9c8f6a0] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:52:29.826134 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-7de21903-e4e1-4319-af7a-e2ae520e9243 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:29.826614 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-7de21903-e4e1-4319-af7a-e2ae520e9243 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:29.827370 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-7de21903-e4e1-4319-af7a-e2ae520e9243 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:29.827798 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-7de21903-e4e1-4319-af7a-e2ae520e9243 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:29.844003 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.wsgi [None req-7de21903-e4e1-4319-af7a-e2ae520e9243 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] HTTP exception thrown: Instance df3309b1-ba0f-4f40-937f-fc95c9c8f6a0 could not be found. Jul 19 15:52:29.845712 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-7de21903-e4e1-4319-af7a-e2ae520e9243 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Request method failure captured: Jul 19 15:52:29.845712 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: request: GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0 HTTP/1.1 Jul 19 15:52:29.845712 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Accept: application/json Jul 19 15:52:29.845712 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Accept-Encoding: identity Jul 19 15:52:29.845712 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Connection: close Jul 19 15:52:29.845712 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Content-Length: 0 Jul 19 15:52:29.845712 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Content-Type: application/json Jul 19 15:52:29.845712 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Host: 10.222.0.64 Jul 19 15:52:29.845712 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Openstack-System-Scope: None Jul 19 15:52:29.845712 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: User-Agent: python-urllib3/1.26.9 Jul 19 15:52:29.845712 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Auth-Token: gAAAAABi1tGHQ64QBmv4eGgDad1tR5ylzAiZZRMu8S6JEwmmkw0ws4HuMMi_Srl4E3pmdtmusBCj_7F5cD4cGFGiBY5Gg_tG6GXGKe9b6oGy4QHTRNfOPH-xklO2Xd8kIUmNbMKwMVBU2CQWnx3dEeh2vQgUtexBibzvdAzao6A_j97Z_skRgQA Jul 19 15:52:29.845712 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Domain-Id: None Jul 19 15:52:29.845712 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Domain-Name: None Jul 19 15:52:29.845712 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Identity-Status: Confirmed Jul 19 15:52:29.845712 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Is-Admin-Project: True Jul 19 15:52:29.845712 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Openstack-Nova-Api-Version: 2.20 Jul 19 15:52:29.845712 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Domain-Id: default Jul 19 15:52:29.845712 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Domain-Name: Default Jul 19 15:52:29.845712 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Id: 171a2f5462994c8d98ffd8cbc2ce5677 Jul 19 15:52:29.845712 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1314265819 Jul 19 15:52:29.845712 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Role: member,reader Jul 19 15:52:29.845712 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Roles: member,reader Jul 19 15:52:29.847944 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_171a2f5462994c8d98ffd8cbc2ce5677", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/171a2f5462994c8d98ffd8cbc2ce5677"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/171a2f5462994c8d98ffd8cbc2ce5677"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/171a2f5462994c8d98ffd8cbc2ce5677"}]}] Jul 19 15:52:29.847944 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1314265819 Jul 19 15:52:29.847944 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Tenant-Id: 171a2f5462994c8d98ffd8cbc2ce5677 Jul 19 15:52:29.847944 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1314265819 Jul 19 15:52:29.847944 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User: tempest-AttachVolumeShelveTestJSON-1314265819-project Jul 19 15:52:29.847944 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Domain-Id: default Jul 19 15:52:29.847944 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Domain-Name: Default Jul 19 15:52:29.847944 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Id: fca86639f2d344be97cb1529dc17f62a Jul 19 15:52:29.847944 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1314265819-project Jul 19 15:52:29.847944 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: method: > Jul 19 15:52:29.847944 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: exception: Instance df3309b1-ba0f-4f40-937f-fc95c9c8f6a0 could not be found. Jul 19 15:52:29.847944 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: action_args: {'id': 'df3309b1-ba0f-4f40-937f-fc95c9c8f6a0'} Jul 19 15:52:29.848910 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:52:29.848910 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:52:29.848910 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 15:52:29.848910 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 15:52:29.848910 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 15:52:29.848910 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 15:52:29.848910 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 15:52:29.848910 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 15:52:29.848910 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 15:52:29.848910 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 15:52:29.848910 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df3309b1-ba0f-4f40-937f-fc95c9c8f6a0 could not be found. Jul 19 15:52:29.848910 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:52:29.848910 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:52:29.848910 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:52:29.848910 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:52:29.848910 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:52:29.848910 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:52:29.848910 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:52:29.848910 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:52:29.848910 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:52:29.850580 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:52:29.850580 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 15:52:29.850580 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 15:52:29.850580 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 15:52:29.850580 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 15:52:29.850580 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 15:52:29.850580 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 15:52:29.850580 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df3309b1-ba0f-4f40-937f-fc95c9c8f6a0 could not be found. Jul 19 15:52:29.850580 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:52:29.850580 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:52:29.850580 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:52:29.850580 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:52:29.850580 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:52:29.850580 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:52:29.850580 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:52:29.850580 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:52:29.850580 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df3309b1-ba0f-4f40-937f-fc95c9c8f6a0 could not be found. Jul 19 15:52:29.850580 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:52:29.852314 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-7de21903-e4e1-4319-af7a-e2ae520e9243 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Returning 404 to user: Instance df3309b1-ba0f-4f40-937f-fc95c9c8f6a0 could not be found. {{(pid=129519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:52:29.852314 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-7de21903-e4e1-4319-af7a-e2ae520e9243 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0" status: 404 len: 111 microversion: 2.20 time: 0.033084 Jul 19 15:52:29.852314 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 454/960] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:52:29 2022] GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 19 15:52:29.856876 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-dfd5cf2a-e7c9-4e37-b7c7-4d497ab24533 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '.version_select at 0x7fb8a5bfc1f0>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:29.879289 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-dfd5cf2a-e7c9-4e37-b7c7-4d497ab24533 tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2037912774" status: 204 len: 0 microversion: 2.20 time: 0.026160 Jul 19 15:52:29.879943 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 507/961] 10.222.0.64 () {60 vars in 1261 bytes} [Tue Jul 19 15:52:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2037912774 => generated 0 bytes in 27 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 19 15:52:30.308906 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-b0fa689f-72dd-4fa3-afaa-c8aed4d0726b tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:30.309806 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-b0fa689f-72dd-4fa3-afaa-c8aed4d0726b tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: ef0f43ac-fd71-43ae-9213-9c3ab5f59161] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:52:30.319373 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-b0fa689f-72dd-4fa3-afaa-c8aed4d0726b tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:30.320044 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-b0fa689f-72dd-4fa3-afaa-c8aed4d0726b tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:30.321134 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-b0fa689f-72dd-4fa3-afaa-c8aed4d0726b tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:30.321678 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-b0fa689f-72dd-4fa3-afaa-c8aed4d0726b tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:30.541236 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-b0fa689f-72dd-4fa3-afaa-c8aed4d0726b tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7c42cf0bc84292bb0b7edb9f2e7fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a72d232f314a78b0e1c3f04b0ed682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:52:30.543783 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG dbcounter [-] [129519] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=129519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:52:30.559535 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-b0fa689f-72dd-4fa3-afaa-c8aed4d0726b tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/ef0f43ac-fd71-43ae-9213-9c3ab5f59161" status: 200 len: 1680 microversion: 2.1 time: 0.254248 Jul 19 15:52:30.560689 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 455/962] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:52:30 2022] GET /compute/v2.1/servers/ef0f43ac-fd71-43ae-9213-9c3ab5f59161 => generated 1680 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:52:31.552299 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [req-8c562b50-059a-48f6-aed3-69ab5421a800 req-23b8261e-f616-4226-80fc-2bce4c335f34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef0f43ac-fd71-43ae-9213-9c3ab5f59161", "name": "network-vif-deleted", "tag": "b5584b46-dc66-4b7c-8ae4-94dc57d1af3b"}]} {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:52:31.562397 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [req-8c562b50-059a-48f6-aed3-69ab5421a800 req-23b8261e-f616-4226-80fc-2bce4c335f34 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:31.562833 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [req-8c562b50-059a-48f6-aed3-69ab5421a800 req-23b8261e-f616-4226-80fc-2bce4c335f34 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:31.577075 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-6a14d92c-e844-4eef-adb8-7fba945cf948 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:31.578388 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-6a14d92c-e844-4eef-adb8-7fba945cf948 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: ef0f43ac-fd71-43ae-9213-9c3ab5f59161] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:52:31.586752 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.compute.server_external_events [req-8c562b50-059a-48f6-aed3-69ab5421a800 req-23b8261e-f616-4226-80fc-2bce4c335f34 service nova] Creating event network-vif-deleted:b5584b46-dc66-4b7c-8ae4-94dc57d1af3b for instance ef0f43ac-fd71-43ae-9213-9c3ab5f59161 on hv-cinder-84902 Jul 19 15:52:31.595864 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-6a14d92c-e844-4eef-adb8-7fba945cf948 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:31.596807 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-6a14d92c-e844-4eef-adb8-7fba945cf948 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:31.598620 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [req-8c562b50-059a-48f6-aed3-69ab5421a800 req-23b8261e-f616-4226-80fc-2bce4c335f34 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051025 Jul 19 15:52:31.600302 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-6a14d92c-e844-4eef-adb8-7fba945cf948 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:31.600817 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-6a14d92c-e844-4eef-adb8-7fba945cf948 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:31.601204 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 508/963] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Jul 19 15:52:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:52:31.678436 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-6a14d92c-e844-4eef-adb8-7fba945cf948 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d7c42cf0bc84292bb0b7edb9f2e7fc3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45a72d232f314a78b0e1c3f04b0ed682', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:52:31.687869 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-6a14d92c-e844-4eef-adb8-7fba945cf948 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/ef0f43ac-fd71-43ae-9213-9c3ab5f59161" status: 200 len: 1326 microversion: 2.1 time: 0.114567 Jul 19 15:52:31.691384 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 456/964] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:52:31 2022] GET /compute/v2.1/servers/ef0f43ac-fd71-43ae-9213-9c3ab5f59161 => generated 1326 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:52:31.795280 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-5298485c-1ca2-4c45-ba59-c9f14f24011a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:31.798111 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-5298485c-1ca2-4c45-ba59-c9f14f24011a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: df3309b1-ba0f-4f40-937f-fc95c9c8f6a0] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:52:31.806319 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-5298485c-1ca2-4c45-ba59-c9f14f24011a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:31.806819 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-5298485c-1ca2-4c45-ba59-c9f14f24011a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:31.807650 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-5298485c-1ca2-4c45-ba59-c9f14f24011a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:31.808026 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-5298485c-1ca2-4c45-ba59-c9f14f24011a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:31.824556 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.wsgi [None req-5298485c-1ca2-4c45-ba59-c9f14f24011a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] HTTP exception thrown: Instance df3309b1-ba0f-4f40-937f-fc95c9c8f6a0 could not be found. Jul 19 15:52:31.826256 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-5298485c-1ca2-4c45-ba59-c9f14f24011a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Request method failure captured: Jul 19 15:52:31.826256 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: request: DELETE /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0 HTTP/1.1 Jul 19 15:52:31.826256 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Accept: application/json Jul 19 15:52:31.826256 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Accept-Encoding: identity Jul 19 15:52:31.826256 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Connection: close Jul 19 15:52:31.826256 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Content-Length: 0 Jul 19 15:52:31.826256 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Content-Type: application/json Jul 19 15:52:31.826256 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Host: 10.222.0.64 Jul 19 15:52:31.826256 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Openstack-System-Scope: None Jul 19 15:52:31.826256 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: User-Agent: python-urllib3/1.26.9 Jul 19 15:52:31.826256 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Auth-Token: gAAAAABi1tGHQ64QBmv4eGgDad1tR5ylzAiZZRMu8S6JEwmmkw0ws4HuMMi_Srl4E3pmdtmusBCj_7F5cD4cGFGiBY5Gg_tG6GXGKe9b6oGy4QHTRNfOPH-xklO2Xd8kIUmNbMKwMVBU2CQWnx3dEeh2vQgUtexBibzvdAzao6A_j97Z_skRgQA Jul 19 15:52:31.826256 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Domain-Id: None Jul 19 15:52:31.826256 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Domain-Name: None Jul 19 15:52:31.826256 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Identity-Status: Confirmed Jul 19 15:52:31.826256 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Is-Admin-Project: True Jul 19 15:52:31.826256 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Openstack-Nova-Api-Version: 2.20 Jul 19 15:52:31.826256 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Project-Domain-Id: default Jul 19 15:52:31.826256 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Project-Domain-Name: Default Jul 19 15:52:31.826256 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Project-Id: 171a2f5462994c8d98ffd8cbc2ce5677 Jul 19 15:52:31.826256 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1314265819 Jul 19 15:52:31.826256 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Role: member,reader Jul 19 15:52:31.826256 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Roles: member,reader Jul 19 15:52:31.827835 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_171a2f5462994c8d98ffd8cbc2ce5677", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/171a2f5462994c8d98ffd8cbc2ce5677"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/171a2f5462994c8d98ffd8cbc2ce5677"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/171a2f5462994c8d98ffd8cbc2ce5677"}]}] Jul 19 15:52:31.827835 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1314265819 Jul 19 15:52:31.827835 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Tenant-Id: 171a2f5462994c8d98ffd8cbc2ce5677 Jul 19 15:52:31.827835 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1314265819 Jul 19 15:52:31.827835 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User: tempest-AttachVolumeShelveTestJSON-1314265819-project Jul 19 15:52:31.827835 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User-Domain-Id: default Jul 19 15:52:31.827835 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User-Domain-Name: Default Jul 19 15:52:31.827835 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User-Id: fca86639f2d344be97cb1529dc17f62a Jul 19 15:52:31.827835 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1314265819-project Jul 19 15:52:31.827835 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: method: > Jul 19 15:52:31.827835 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: exception: Instance df3309b1-ba0f-4f40-937f-fc95c9c8f6a0 could not be found. Jul 19 15:52:31.827835 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: action_args: {'id': 'df3309b1-ba0f-4f40-937f-fc95c9c8f6a0'} Jul 19 15:52:31.828747 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:52:31.828747 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:52:31.828747 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 15:52:31.828747 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 15:52:31.828747 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 15:52:31.828747 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 15:52:31.828747 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 15:52:31.828747 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 15:52:31.828747 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 15:52:31.828747 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 15:52:31.828747 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df3309b1-ba0f-4f40-937f-fc95c9c8f6a0 could not be found. Jul 19 15:52:31.828747 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:52:31.828747 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:52:31.828747 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:52:31.828747 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:52:31.828747 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:52:31.828747 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:52:31.828747 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:52:31.828747 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:52:31.828747 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:52:31.830110 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:52:31.830110 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 15:52:31.830110 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 15:52:31.830110 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 15:52:31.830110 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 15:52:31.830110 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 15:52:31.830110 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 15:52:31.830110 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 15:52:31.830110 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 15:52:31.830110 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df3309b1-ba0f-4f40-937f-fc95c9c8f6a0 could not be found. Jul 19 15:52:31.830110 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:52:31.830110 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:52:31.830110 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:52:31.830110 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:52:31.830110 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:52:31.830110 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:52:31.830110 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:52:31.830110 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:52:31.830110 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df3309b1-ba0f-4f40-937f-fc95c9c8f6a0 could not be found. Jul 19 15:52:31.830110 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:52:31.831622 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-5298485c-1ca2-4c45-ba59-c9f14f24011a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Returning 404 to user: Instance df3309b1-ba0f-4f40-937f-fc95c9c8f6a0 could not be found. {{(pid=129520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:52:31.831622 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-5298485c-1ca2-4c45-ba59-c9f14f24011a tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "DELETE /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0" status: 404 len: 111 microversion: 2.20 time: 0.040592 Jul 19 15:52:31.831622 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 509/965] 10.222.0.64 () {60 vars in 1279 bytes} [Tue Jul 19 15:52:31 2022] DELETE /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 19 15:52:31.836947 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-9f755448-4c2b-4043-aed9-c0bff6997ece tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:31.837555 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-9f755448-4c2b-4043-aed9-c0bff6997ece tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: df3309b1-ba0f-4f40-937f-fc95c9c8f6a0] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:52:31.843677 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-9f755448-4c2b-4043-aed9-c0bff6997ece tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:31.844128 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-9f755448-4c2b-4043-aed9-c0bff6997ece tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:31.844896 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-9f755448-4c2b-4043-aed9-c0bff6997ece tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:31.845339 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-9f755448-4c2b-4043-aed9-c0bff6997ece tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:31.858825 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.wsgi [None req-9f755448-4c2b-4043-aed9-c0bff6997ece tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] HTTP exception thrown: Instance df3309b1-ba0f-4f40-937f-fc95c9c8f6a0 could not be found. Jul 19 15:52:31.860298 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-9f755448-4c2b-4043-aed9-c0bff6997ece tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Request method failure captured: Jul 19 15:52:31.860298 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: request: GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0 HTTP/1.1 Jul 19 15:52:31.860298 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Accept: application/json Jul 19 15:52:31.860298 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Accept-Encoding: identity Jul 19 15:52:31.860298 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Connection: close Jul 19 15:52:31.860298 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Content-Length: 0 Jul 19 15:52:31.860298 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Content-Type: application/json Jul 19 15:52:31.860298 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Host: 10.222.0.64 Jul 19 15:52:31.860298 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Openstack-System-Scope: None Jul 19 15:52:31.860298 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: User-Agent: python-urllib3/1.26.9 Jul 19 15:52:31.860298 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Auth-Token: gAAAAABi1tGHQ64QBmv4eGgDad1tR5ylzAiZZRMu8S6JEwmmkw0ws4HuMMi_Srl4E3pmdtmusBCj_7F5cD4cGFGiBY5Gg_tG6GXGKe9b6oGy4QHTRNfOPH-xklO2Xd8kIUmNbMKwMVBU2CQWnx3dEeh2vQgUtexBibzvdAzao6A_j97Z_skRgQA Jul 19 15:52:31.860298 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Domain-Id: None Jul 19 15:52:31.860298 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Domain-Name: None Jul 19 15:52:31.860298 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Identity-Status: Confirmed Jul 19 15:52:31.860298 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Is-Admin-Project: True Jul 19 15:52:31.860298 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Openstack-Nova-Api-Version: 2.20 Jul 19 15:52:31.860298 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Domain-Id: default Jul 19 15:52:31.860298 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Domain-Name: Default Jul 19 15:52:31.860298 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Id: 171a2f5462994c8d98ffd8cbc2ce5677 Jul 19 15:52:31.860298 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1314265819 Jul 19 15:52:31.860298 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Role: member,reader Jul 19 15:52:31.860298 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Roles: member,reader Jul 19 15:52:31.861927 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_171a2f5462994c8d98ffd8cbc2ce5677", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/171a2f5462994c8d98ffd8cbc2ce5677"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/171a2f5462994c8d98ffd8cbc2ce5677"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/171a2f5462994c8d98ffd8cbc2ce5677"}]}] Jul 19 15:52:31.861927 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1314265819 Jul 19 15:52:31.861927 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Tenant-Id: 171a2f5462994c8d98ffd8cbc2ce5677 Jul 19 15:52:31.861927 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1314265819 Jul 19 15:52:31.861927 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User: tempest-AttachVolumeShelveTestJSON-1314265819-project Jul 19 15:52:31.861927 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Domain-Id: default Jul 19 15:52:31.861927 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Domain-Name: Default Jul 19 15:52:31.861927 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Id: fca86639f2d344be97cb1529dc17f62a Jul 19 15:52:31.861927 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1314265819-project Jul 19 15:52:31.861927 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: method: > Jul 19 15:52:31.861927 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: exception: Instance df3309b1-ba0f-4f40-937f-fc95c9c8f6a0 could not be found. Jul 19 15:52:31.861927 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: action_args: {'id': 'df3309b1-ba0f-4f40-937f-fc95c9c8f6a0'} Jul 19 15:52:31.866384 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:52:31.866384 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:52:31.866384 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 15:52:31.866384 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 15:52:31.866384 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 15:52:31.866384 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 15:52:31.866384 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 15:52:31.866384 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 15:52:31.866384 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 15:52:31.866384 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 15:52:31.866384 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df3309b1-ba0f-4f40-937f-fc95c9c8f6a0 could not be found. Jul 19 15:52:31.866384 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:52:31.866384 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:52:31.866384 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:52:31.866384 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:52:31.866384 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:52:31.866384 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:52:31.866384 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:52:31.866384 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:52:31.866384 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:52:31.867718 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:52:31.867718 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 15:52:31.867718 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 15:52:31.867718 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 15:52:31.867718 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 15:52:31.867718 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 15:52:31.867718 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 15:52:31.867718 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df3309b1-ba0f-4f40-937f-fc95c9c8f6a0 could not be found. Jul 19 15:52:31.867718 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:52:31.867718 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:52:31.867718 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:52:31.867718 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:52:31.867718 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:52:31.867718 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:52:31.867718 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:52:31.867718 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:52:31.867718 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df3309b1-ba0f-4f40-937f-fc95c9c8f6a0 could not be found. Jul 19 15:52:31.867718 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:52:31.869411 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-9f755448-4c2b-4043-aed9-c0bff6997ece tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Returning 404 to user: Instance df3309b1-ba0f-4f40-937f-fc95c9c8f6a0 could not be found. {{(pid=129519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:52:31.869411 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-9f755448-4c2b-4043-aed9-c0bff6997ece tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0" status: 404 len: 111 microversion: 2.20 time: 0.028645 Jul 19 15:52:31.869411 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 457/966] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:52:31 2022] GET /compute/v2.1/servers/df3309b1-ba0f-4f40-937f-fc95c9c8f6a0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 19 15:52:32.708334 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-92f646a1-e320-4d8b-b058-1da77289ef3d tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:32.709820 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-92f646a1-e320-4d8b-b058-1da77289ef3d tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: ef0f43ac-fd71-43ae-9213-9c3ab5f59161] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:52:32.717008 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-92f646a1-e320-4d8b-b058-1da77289ef3d tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:32.717552 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-92f646a1-e320-4d8b-b058-1da77289ef3d tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:32.718440 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-92f646a1-e320-4d8b-b058-1da77289ef3d tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:32.719075 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-92f646a1-e320-4d8b-b058-1da77289ef3d tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:32.735212 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.wsgi [None req-92f646a1-e320-4d8b-b058-1da77289ef3d tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] HTTP exception thrown: Instance ef0f43ac-fd71-43ae-9213-9c3ab5f59161 could not be found. Jul 19 15:52:32.737415 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-92f646a1-e320-4d8b-b058-1da77289ef3d tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Request method failure captured: Jul 19 15:52:32.737415 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: request: GET /compute/v2.1/servers/ef0f43ac-fd71-43ae-9213-9c3ab5f59161 HTTP/1.1 Jul 19 15:52:32.737415 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Accept: application/json Jul 19 15:52:32.737415 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Accept-Encoding: identity Jul 19 15:52:32.737415 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Connection: close Jul 19 15:52:32.737415 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Content-Length: 0 Jul 19 15:52:32.737415 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Content-Type: application/json Jul 19 15:52:32.737415 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Host: 10.222.0.64 Jul 19 15:52:32.737415 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Openstack-System-Scope: None Jul 19 15:52:32.737415 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: User-Agent: python-urllib3/1.26.9 Jul 19 15:52:32.737415 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Auth-Token: gAAAAABi1tGPtVnrBLo0yCDS-Fxp117KmoW30EOrAzeE-HWJZTaOLzmdVU7ilJLT24AK1cNZoT6hZsY9VJG83Xk6FPFrebHG3s54Fuj7pMRO-j7b_NklvH50XPBLW-GpDpGZ3ebrTqCiTKXUJEZA0zlfYPmMdreiVMLme-IYyDlHVZle_DtpLr0 Jul 19 15:52:32.737415 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Domain-Id: None Jul 19 15:52:32.737415 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Domain-Name: None Jul 19 15:52:32.737415 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Identity-Status: Confirmed Jul 19 15:52:32.737415 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Is-Admin-Project: True Jul 19 15:52:32.737415 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Project-Domain-Id: default Jul 19 15:52:32.737415 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Project-Domain-Name: Default Jul 19 15:52:32.737415 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Project-Id: 45a72d232f314a78b0e1c3f04b0ed682 Jul 19 15:52:32.737415 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Project-Name: tempest-AttachVolumeNegativeTest-1922780758 Jul 19 15:52:32.737415 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Role: member,reader Jul 19 15:52:32.737415 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Roles: member,reader Jul 19 15:52:32.739137 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_45a72d232f314a78b0e1c3f04b0ed682", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/45a72d232f314a78b0e1c3f04b0ed682"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/45a72d232f314a78b0e1c3f04b0ed682"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/45a72d232f314a78b0e1c3f04b0ed682"}]}] Jul 19 15:52:32.739137 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Tenant: tempest-AttachVolumeNegativeTest-1922780758 Jul 19 15:52:32.739137 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Tenant-Id: 45a72d232f314a78b0e1c3f04b0ed682 Jul 19 15:52:32.739137 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1922780758 Jul 19 15:52:32.739137 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User: tempest-AttachVolumeNegativeTest-1922780758-project Jul 19 15:52:32.739137 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User-Domain-Id: default Jul 19 15:52:32.739137 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User-Domain-Name: Default Jul 19 15:52:32.739137 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User-Id: 2d7c42cf0bc84292bb0b7edb9f2e7fc3 Jul 19 15:52:32.739137 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User-Name: tempest-AttachVolumeNegativeTest-1922780758-project Jul 19 15:52:32.739137 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: method: > Jul 19 15:52:32.739137 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: exception: Instance ef0f43ac-fd71-43ae-9213-9c3ab5f59161 could not be found. Jul 19 15:52:32.739137 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: action_args: {'id': 'ef0f43ac-fd71-43ae-9213-9c3ab5f59161'} Jul 19 15:52:32.740107 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:52:32.740107 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:52:32.740107 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 15:52:32.740107 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 15:52:32.740107 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 15:52:32.740107 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 15:52:32.740107 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 15:52:32.740107 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 15:52:32.740107 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 15:52:32.740107 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 15:52:32.740107 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef0f43ac-fd71-43ae-9213-9c3ab5f59161 could not be found. Jul 19 15:52:32.740107 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:52:32.740107 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:52:32.740107 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:52:32.740107 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:52:32.740107 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:52:32.740107 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:52:32.740107 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:52:32.740107 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:52:32.740107 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:52:32.741305 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:52:32.741305 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 15:52:32.741305 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 15:52:32.741305 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 15:52:32.741305 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 15:52:32.741305 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 15:52:32.741305 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 15:52:32.741305 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef0f43ac-fd71-43ae-9213-9c3ab5f59161 could not be found. Jul 19 15:52:32.741305 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:52:32.741305 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:52:32.741305 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:52:32.741305 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:52:32.741305 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:52:32.741305 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:52:32.741305 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:52:32.741305 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:52:32.741305 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef0f43ac-fd71-43ae-9213-9c3ab5f59161 could not be found. Jul 19 15:52:32.741305 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:52:32.743954 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-92f646a1-e320-4d8b-b058-1da77289ef3d tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Returning 404 to user: Instance ef0f43ac-fd71-43ae-9213-9c3ab5f59161 could not be found. {{(pid=129520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:52:32.744943 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-92f646a1-e320-4d8b-b058-1da77289ef3d tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/ef0f43ac-fd71-43ae-9213-9c3ab5f59161" status: 404 len: 111 microversion: 2.1 time: 0.041515 Jul 19 15:52:32.745722 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 510/967] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:52:32 2022] GET /compute/v2.1/servers/ef0f43ac-fd71-43ae-9213-9c3ab5f59161 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 15:52:32.755337 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-cead0f6b-cea2-4b9d-a8d8-3d965158a174 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '.version_select at 0x7fb8a5b56a60>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:32.774086 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-cead0f6b-cea2-4b9d-a8d8-3d965158a174 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1356458409" status: 202 len: 0 microversion: 2.1 time: 0.023552 Jul 19 15:52:32.775129 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 458/968] 10.222.0.64 () {58 vars in 1220 bytes} [Tue Jul 19 15:52:32 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1356458409 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 15:52:33.003719 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-8e815f74-0b0f-4246-b296-4910ee71303d tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:33.004347 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-8e815f74-0b0f-4246-b296-4910ee71303d tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:52:33.010705 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-8e815f74-0b0f-4246-b296-4910ee71303d tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:33.011273 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-8e815f74-0b0f-4246-b296-4910ee71303d tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:33.012340 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-8e815f74-0b0f-4246-b296-4910ee71303d tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:33.012810 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-8e815f74-0b0f-4246-b296-4910ee71303d tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:33.026906 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.wsgi [None req-8e815f74-0b0f-4246-b296-4910ee71303d tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] HTTP exception thrown: Instance 3eeb4a51-a06c-4faf-9a63-bf3658ca773b could not be found. Jul 19 15:52:33.028460 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-8e815f74-0b0f-4246-b296-4910ee71303d tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Request method failure captured: Jul 19 15:52:33.028460 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: request: DELETE /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b HTTP/1.1 Jul 19 15:52:33.028460 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Accept: application/json Jul 19 15:52:33.028460 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Accept-Encoding: identity Jul 19 15:52:33.028460 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Connection: close Jul 19 15:52:33.028460 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Content-Length: 0 Jul 19 15:52:33.028460 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Content-Type: application/json Jul 19 15:52:33.028460 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Host: 10.222.0.64 Jul 19 15:52:33.028460 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Openstack-System-Scope: None Jul 19 15:52:33.028460 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: User-Agent: python-urllib3/1.26.9 Jul 19 15:52:33.028460 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Auth-Token: gAAAAABi1tGHQ64QBmv4eGgDad1tR5ylzAiZZRMu8S6JEwmmkw0ws4HuMMi_Srl4E3pmdtmusBCj_7F5cD4cGFGiBY5Gg_tG6GXGKe9b6oGy4QHTRNfOPH-xklO2Xd8kIUmNbMKwMVBU2CQWnx3dEeh2vQgUtexBibzvdAzao6A_j97Z_skRgQA Jul 19 15:52:33.028460 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Domain-Id: None Jul 19 15:52:33.028460 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Domain-Name: None Jul 19 15:52:33.028460 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Identity-Status: Confirmed Jul 19 15:52:33.028460 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Is-Admin-Project: True Jul 19 15:52:33.028460 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Openstack-Nova-Api-Version: 2.20 Jul 19 15:52:33.028460 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Project-Domain-Id: default Jul 19 15:52:33.028460 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Project-Domain-Name: Default Jul 19 15:52:33.028460 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Project-Id: 171a2f5462994c8d98ffd8cbc2ce5677 Jul 19 15:52:33.028460 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1314265819 Jul 19 15:52:33.028460 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Role: member,reader Jul 19 15:52:33.028460 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Roles: member,reader Jul 19 15:52:33.030013 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_171a2f5462994c8d98ffd8cbc2ce5677", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/171a2f5462994c8d98ffd8cbc2ce5677"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/171a2f5462994c8d98ffd8cbc2ce5677"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/171a2f5462994c8d98ffd8cbc2ce5677"}]}] Jul 19 15:52:33.030013 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1314265819 Jul 19 15:52:33.030013 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Tenant-Id: 171a2f5462994c8d98ffd8cbc2ce5677 Jul 19 15:52:33.030013 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1314265819 Jul 19 15:52:33.030013 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User: tempest-AttachVolumeShelveTestJSON-1314265819-project Jul 19 15:52:33.030013 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User-Domain-Id: default Jul 19 15:52:33.030013 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User-Domain-Name: Default Jul 19 15:52:33.030013 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User-Id: fca86639f2d344be97cb1529dc17f62a Jul 19 15:52:33.030013 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1314265819-project Jul 19 15:52:33.030013 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: method: > Jul 19 15:52:33.030013 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: exception: Instance 3eeb4a51-a06c-4faf-9a63-bf3658ca773b could not be found. Jul 19 15:52:33.030013 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: action_args: {'id': '3eeb4a51-a06c-4faf-9a63-bf3658ca773b'} Jul 19 15:52:33.033789 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:52:33.033789 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:52:33.033789 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 15:52:33.033789 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 15:52:33.033789 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 15:52:33.033789 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 15:52:33.033789 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 15:52:33.033789 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 15:52:33.033789 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 15:52:33.033789 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 15:52:33.033789 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3eeb4a51-a06c-4faf-9a63-bf3658ca773b could not be found. Jul 19 15:52:33.033789 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:52:33.033789 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:52:33.033789 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:52:33.033789 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:52:33.033789 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:52:33.033789 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:52:33.033789 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:52:33.033789 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:52:33.033789 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:52:33.036069 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:52:33.036069 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 15:52:33.036069 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 15:52:33.036069 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 15:52:33.036069 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 15:52:33.036069 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 15:52:33.036069 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 15:52:33.036069 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 15:52:33.036069 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 15:52:33.036069 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3eeb4a51-a06c-4faf-9a63-bf3658ca773b could not be found. Jul 19 15:52:33.036069 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:52:33.036069 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:52:33.036069 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:52:33.036069 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:52:33.036069 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:52:33.036069 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:52:33.036069 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:52:33.036069 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:52:33.036069 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3eeb4a51-a06c-4faf-9a63-bf3658ca773b could not be found. Jul 19 15:52:33.036069 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:52:33.038505 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-8e815f74-0b0f-4246-b296-4910ee71303d tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Returning 404 to user: Instance 3eeb4a51-a06c-4faf-9a63-bf3658ca773b could not be found. {{(pid=129520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:52:33.038505 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-8e815f74-0b0f-4246-b296-4910ee71303d tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "DELETE /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 404 len: 111 microversion: 2.20 time: 0.030728 Jul 19 15:52:33.038505 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 511/969] 10.222.0.64 () {60 vars in 1279 bytes} [Tue Jul 19 15:52:32 2022] DELETE /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 19 15:52:33.038934 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-1e35ac6b-9faa-442e-897d-026be8547afc tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:33.039537 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-1e35ac6b-9faa-442e-897d-026be8547afc tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] [instance: 3eeb4a51-a06c-4faf-9a63-bf3658ca773b] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:52:33.046565 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-1e35ac6b-9faa-442e-897d-026be8547afc tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:33.047011 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-1e35ac6b-9faa-442e-897d-026be8547afc tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:33.047764 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-1e35ac6b-9faa-442e-897d-026be8547afc tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:33.048196 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-1e35ac6b-9faa-442e-897d-026be8547afc tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:33.062216 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.wsgi [None req-1e35ac6b-9faa-442e-897d-026be8547afc tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] HTTP exception thrown: Instance 3eeb4a51-a06c-4faf-9a63-bf3658ca773b could not be found. Jul 19 15:52:33.063852 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-1e35ac6b-9faa-442e-897d-026be8547afc tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Request method failure captured: Jul 19 15:52:33.063852 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: request: GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b HTTP/1.1 Jul 19 15:52:33.063852 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Accept: application/json Jul 19 15:52:33.063852 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Accept-Encoding: identity Jul 19 15:52:33.063852 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Connection: close Jul 19 15:52:33.063852 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Content-Length: 0 Jul 19 15:52:33.063852 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Content-Type: application/json Jul 19 15:52:33.063852 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Host: 10.222.0.64 Jul 19 15:52:33.063852 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Openstack-System-Scope: None Jul 19 15:52:33.063852 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: User-Agent: python-urllib3/1.26.9 Jul 19 15:52:33.063852 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Auth-Token: gAAAAABi1tGHQ64QBmv4eGgDad1tR5ylzAiZZRMu8S6JEwmmkw0ws4HuMMi_Srl4E3pmdtmusBCj_7F5cD4cGFGiBY5Gg_tG6GXGKe9b6oGy4QHTRNfOPH-xklO2Xd8kIUmNbMKwMVBU2CQWnx3dEeh2vQgUtexBibzvdAzao6A_j97Z_skRgQA Jul 19 15:52:33.063852 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Domain-Id: None Jul 19 15:52:33.063852 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Domain-Name: None Jul 19 15:52:33.063852 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Identity-Status: Confirmed Jul 19 15:52:33.063852 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Is-Admin-Project: True Jul 19 15:52:33.063852 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Openstack-Nova-Api-Version: 2.20 Jul 19 15:52:33.063852 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Domain-Id: default Jul 19 15:52:33.063852 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Domain-Name: Default Jul 19 15:52:33.063852 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Id: 171a2f5462994c8d98ffd8cbc2ce5677 Jul 19 15:52:33.063852 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1314265819 Jul 19 15:52:33.063852 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Role: member,reader Jul 19 15:52:33.063852 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Roles: member,reader Jul 19 15:52:33.065684 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_171a2f5462994c8d98ffd8cbc2ce5677", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/171a2f5462994c8d98ffd8cbc2ce5677"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/171a2f5462994c8d98ffd8cbc2ce5677"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/171a2f5462994c8d98ffd8cbc2ce5677"}]}] Jul 19 15:52:33.065684 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1314265819 Jul 19 15:52:33.065684 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Tenant-Id: 171a2f5462994c8d98ffd8cbc2ce5677 Jul 19 15:52:33.065684 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1314265819 Jul 19 15:52:33.065684 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User: tempest-AttachVolumeShelveTestJSON-1314265819-project Jul 19 15:52:33.065684 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Domain-Id: default Jul 19 15:52:33.065684 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Domain-Name: Default Jul 19 15:52:33.065684 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Id: fca86639f2d344be97cb1529dc17f62a Jul 19 15:52:33.065684 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1314265819-project Jul 19 15:52:33.065684 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: method: > Jul 19 15:52:33.065684 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: exception: Instance 3eeb4a51-a06c-4faf-9a63-bf3658ca773b could not be found. Jul 19 15:52:33.065684 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: action_args: {'id': '3eeb4a51-a06c-4faf-9a63-bf3658ca773b'} Jul 19 15:52:33.066799 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:52:33.066799 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:52:33.066799 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 15:52:33.066799 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 15:52:33.066799 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 15:52:33.066799 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 15:52:33.066799 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 15:52:33.066799 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 15:52:33.066799 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 15:52:33.066799 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 15:52:33.066799 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3eeb4a51-a06c-4faf-9a63-bf3658ca773b could not be found. Jul 19 15:52:33.066799 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:52:33.066799 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:52:33.066799 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:52:33.066799 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:52:33.066799 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:52:33.066799 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:52:33.066799 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:52:33.066799 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:52:33.066799 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:52:33.068352 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:52:33.068352 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 15:52:33.068352 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 15:52:33.068352 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 15:52:33.068352 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 15:52:33.068352 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 15:52:33.068352 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 15:52:33.068352 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3eeb4a51-a06c-4faf-9a63-bf3658ca773b could not be found. Jul 19 15:52:33.068352 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:52:33.068352 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:52:33.068352 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:52:33.068352 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:52:33.068352 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:52:33.068352 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:52:33.068352 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:52:33.068352 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:52:33.068352 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3eeb4a51-a06c-4faf-9a63-bf3658ca773b could not be found. Jul 19 15:52:33.068352 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:52:33.069824 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-1e35ac6b-9faa-442e-897d-026be8547afc tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] Returning 404 to user: Instance 3eeb4a51-a06c-4faf-9a63-bf3658ca773b could not be found. {{(pid=129519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:52:33.069824 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-1e35ac6b-9faa-442e-897d-026be8547afc tempest-AttachVolumeShelveTestJSON-1314265819 tempest-AttachVolumeShelveTestJSON-1314265819-project] 10.222.0.64 "GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b" status: 404 len: 111 microversion: 2.20 time: 0.030770 Jul 19 15:52:33.069824 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 459/970] 10.222.0.64 () {60 vars in 1276 bytes} [Tue Jul 19 15:52:33 2022] GET /compute/v2.1/servers/3eeb4a51-a06c-4faf-9a63-bf3658ca773b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 19 15:52:34.530559 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-fa017890-a662-4be4-ac9c-b6c38eac6577 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:34.531102 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-fa017890-a662-4be4-ac9c-b6c38eac6577 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: ef0f43ac-fd71-43ae-9213-9c3ab5f59161] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:52:34.538343 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-fa017890-a662-4be4-ac9c-b6c38eac6577 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:34.538836 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-fa017890-a662-4be4-ac9c-b6c38eac6577 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:34.539615 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-fa017890-a662-4be4-ac9c-b6c38eac6577 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:34.540057 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-fa017890-a662-4be4-ac9c-b6c38eac6577 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:34.555052 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.wsgi [None req-fa017890-a662-4be4-ac9c-b6c38eac6577 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] HTTP exception thrown: Instance ef0f43ac-fd71-43ae-9213-9c3ab5f59161 could not be found. Jul 19 15:52:34.556650 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-fa017890-a662-4be4-ac9c-b6c38eac6577 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Request method failure captured: Jul 19 15:52:34.556650 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: request: DELETE /compute/v2.1/servers/ef0f43ac-fd71-43ae-9213-9c3ab5f59161 HTTP/1.1 Jul 19 15:52:34.556650 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Accept: application/json Jul 19 15:52:34.556650 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Accept-Encoding: identity Jul 19 15:52:34.556650 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Connection: close Jul 19 15:52:34.556650 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Content-Length: 0 Jul 19 15:52:34.556650 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Content-Type: application/json Jul 19 15:52:34.556650 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Host: 10.222.0.64 Jul 19 15:52:34.556650 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Openstack-System-Scope: None Jul 19 15:52:34.556650 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: User-Agent: python-urllib3/1.26.9 Jul 19 15:52:34.556650 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Auth-Token: gAAAAABi1tGPtVnrBLo0yCDS-Fxp117KmoW30EOrAzeE-HWJZTaOLzmdVU7ilJLT24AK1cNZoT6hZsY9VJG83Xk6FPFrebHG3s54Fuj7pMRO-j7b_NklvH50XPBLW-GpDpGZ3ebrTqCiTKXUJEZA0zlfYPmMdreiVMLme-IYyDlHVZle_DtpLr0 Jul 19 15:52:34.556650 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Domain-Id: None Jul 19 15:52:34.556650 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Domain-Name: None Jul 19 15:52:34.556650 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Identity-Status: Confirmed Jul 19 15:52:34.556650 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Is-Admin-Project: True Jul 19 15:52:34.556650 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Project-Domain-Id: default Jul 19 15:52:34.556650 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Project-Domain-Name: Default Jul 19 15:52:34.556650 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Project-Id: 45a72d232f314a78b0e1c3f04b0ed682 Jul 19 15:52:34.556650 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Project-Name: tempest-AttachVolumeNegativeTest-1922780758 Jul 19 15:52:34.556650 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Role: member,reader Jul 19 15:52:34.556650 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Roles: member,reader Jul 19 15:52:34.558238 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_45a72d232f314a78b0e1c3f04b0ed682", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/45a72d232f314a78b0e1c3f04b0ed682"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/45a72d232f314a78b0e1c3f04b0ed682"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/45a72d232f314a78b0e1c3f04b0ed682"}]}] Jul 19 15:52:34.558238 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Tenant: tempest-AttachVolumeNegativeTest-1922780758 Jul 19 15:52:34.558238 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Tenant-Id: 45a72d232f314a78b0e1c3f04b0ed682 Jul 19 15:52:34.558238 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1922780758 Jul 19 15:52:34.558238 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User: tempest-AttachVolumeNegativeTest-1922780758-project Jul 19 15:52:34.558238 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User-Domain-Id: default Jul 19 15:52:34.558238 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User-Domain-Name: Default Jul 19 15:52:34.558238 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User-Id: 2d7c42cf0bc84292bb0b7edb9f2e7fc3 Jul 19 15:52:34.558238 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User-Name: tempest-AttachVolumeNegativeTest-1922780758-project Jul 19 15:52:34.558238 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: method: > Jul 19 15:52:34.558238 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: exception: Instance ef0f43ac-fd71-43ae-9213-9c3ab5f59161 could not be found. Jul 19 15:52:34.558238 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: action_args: {'id': 'ef0f43ac-fd71-43ae-9213-9c3ab5f59161'} Jul 19 15:52:34.559123 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:52:34.559123 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:52:34.559123 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 15:52:34.559123 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 15:52:34.559123 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 15:52:34.559123 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 15:52:34.559123 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 15:52:34.559123 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 15:52:34.559123 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 15:52:34.559123 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 15:52:34.559123 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef0f43ac-fd71-43ae-9213-9c3ab5f59161 could not be found. Jul 19 15:52:34.559123 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:52:34.559123 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:52:34.559123 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:52:34.559123 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:52:34.559123 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:52:34.559123 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:52:34.559123 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:52:34.559123 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:52:34.559123 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:52:34.560361 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:52:34.560361 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 15:52:34.560361 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 15:52:34.560361 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 15:52:34.560361 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 15:52:34.560361 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 15:52:34.560361 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 15:52:34.560361 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 15:52:34.560361 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 15:52:34.560361 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef0f43ac-fd71-43ae-9213-9c3ab5f59161 could not be found. Jul 19 15:52:34.560361 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:52:34.560361 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:52:34.560361 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:52:34.560361 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:52:34.560361 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:52:34.560361 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:52:34.560361 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:52:34.560361 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:52:34.560361 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef0f43ac-fd71-43ae-9213-9c3ab5f59161 could not be found. Jul 19 15:52:34.560361 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:52:34.561596 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-fa017890-a662-4be4-ac9c-b6c38eac6577 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Returning 404 to user: Instance ef0f43ac-fd71-43ae-9213-9c3ab5f59161 could not be found. {{(pid=129520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:52:34.561596 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-fa017890-a662-4be4-ac9c-b6c38eac6577 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "DELETE /compute/v2.1/servers/ef0f43ac-fd71-43ae-9213-9c3ab5f59161" status: 404 len: 111 microversion: 2.1 time: 0.031415 Jul 19 15:52:34.561596 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 512/971] 10.222.0.64 () {58 vars in 1238 bytes} [Tue Jul 19 15:52:34 2022] DELETE /compute/v2.1/servers/ef0f43ac-fd71-43ae-9213-9c3ab5f59161 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 15:52:34.566746 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-b17cd115-680f-4a0d-bd04-1546f239f24d tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:34.567378 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-b17cd115-680f-4a0d-bd04-1546f239f24d tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: ef0f43ac-fd71-43ae-9213-9c3ab5f59161] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:52:34.574367 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-b17cd115-680f-4a0d-bd04-1546f239f24d tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:34.574843 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-b17cd115-680f-4a0d-bd04-1546f239f24d tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:34.575626 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-b17cd115-680f-4a0d-bd04-1546f239f24d tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:34.576067 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-b17cd115-680f-4a0d-bd04-1546f239f24d tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:34.590707 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.wsgi [None req-b17cd115-680f-4a0d-bd04-1546f239f24d tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] HTTP exception thrown: Instance ef0f43ac-fd71-43ae-9213-9c3ab5f59161 could not be found. Jul 19 15:52:34.592256 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-b17cd115-680f-4a0d-bd04-1546f239f24d tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Request method failure captured: Jul 19 15:52:34.592256 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: request: GET /compute/v2.1/servers/ef0f43ac-fd71-43ae-9213-9c3ab5f59161 HTTP/1.1 Jul 19 15:52:34.592256 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Accept: application/json Jul 19 15:52:34.592256 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Accept-Encoding: identity Jul 19 15:52:34.592256 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Connection: close Jul 19 15:52:34.592256 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Content-Length: 0 Jul 19 15:52:34.592256 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Content-Type: application/json Jul 19 15:52:34.592256 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Host: 10.222.0.64 Jul 19 15:52:34.592256 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Openstack-System-Scope: None Jul 19 15:52:34.592256 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: User-Agent: python-urllib3/1.26.9 Jul 19 15:52:34.592256 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Auth-Token: gAAAAABi1tGPtVnrBLo0yCDS-Fxp117KmoW30EOrAzeE-HWJZTaOLzmdVU7ilJLT24AK1cNZoT6hZsY9VJG83Xk6FPFrebHG3s54Fuj7pMRO-j7b_NklvH50XPBLW-GpDpGZ3ebrTqCiTKXUJEZA0zlfYPmMdreiVMLme-IYyDlHVZle_DtpLr0 Jul 19 15:52:34.592256 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Domain-Id: None Jul 19 15:52:34.592256 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Domain-Name: None Jul 19 15:52:34.592256 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Identity-Status: Confirmed Jul 19 15:52:34.592256 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Is-Admin-Project: True Jul 19 15:52:34.592256 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Domain-Id: default Jul 19 15:52:34.592256 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Domain-Name: Default Jul 19 15:52:34.592256 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Id: 45a72d232f314a78b0e1c3f04b0ed682 Jul 19 15:52:34.592256 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Name: tempest-AttachVolumeNegativeTest-1922780758 Jul 19 15:52:34.592256 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Role: member,reader Jul 19 15:52:34.592256 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Roles: member,reader Jul 19 15:52:34.593891 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_45a72d232f314a78b0e1c3f04b0ed682", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/45a72d232f314a78b0e1c3f04b0ed682"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/45a72d232f314a78b0e1c3f04b0ed682"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/45a72d232f314a78b0e1c3f04b0ed682"}]}] Jul 19 15:52:34.593891 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Tenant: tempest-AttachVolumeNegativeTest-1922780758 Jul 19 15:52:34.593891 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Tenant-Id: 45a72d232f314a78b0e1c3f04b0ed682 Jul 19 15:52:34.593891 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1922780758 Jul 19 15:52:34.593891 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User: tempest-AttachVolumeNegativeTest-1922780758-project Jul 19 15:52:34.593891 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Domain-Id: default Jul 19 15:52:34.593891 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Domain-Name: Default Jul 19 15:52:34.593891 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Id: 2d7c42cf0bc84292bb0b7edb9f2e7fc3 Jul 19 15:52:34.593891 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Name: tempest-AttachVolumeNegativeTest-1922780758-project Jul 19 15:52:34.593891 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: method: > Jul 19 15:52:34.593891 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: exception: Instance ef0f43ac-fd71-43ae-9213-9c3ab5f59161 could not be found. Jul 19 15:52:34.593891 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: action_args: {'id': 'ef0f43ac-fd71-43ae-9213-9c3ab5f59161'} Jul 19 15:52:34.594829 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:52:34.594829 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:52:34.594829 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 15:52:34.594829 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 15:52:34.594829 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 15:52:34.594829 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 15:52:34.594829 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 15:52:34.594829 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 15:52:34.594829 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 15:52:34.594829 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 15:52:34.594829 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ef0f43ac-fd71-43ae-9213-9c3ab5f59161 could not be found. Jul 19 15:52:34.594829 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:52:34.594829 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:52:34.594829 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:52:34.594829 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:52:34.594829 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:52:34.594829 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:52:34.594829 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:52:34.594829 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:52:34.594829 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:52:34.596322 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:52:34.596322 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 15:52:34.596322 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 15:52:34.596322 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 15:52:34.596322 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 15:52:34.596322 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 15:52:34.596322 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 15:52:34.596322 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ef0f43ac-fd71-43ae-9213-9c3ab5f59161 could not be found. Jul 19 15:52:34.596322 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:52:34.596322 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:52:34.596322 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:52:34.596322 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:52:34.596322 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:52:34.596322 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:52:34.596322 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:52:34.596322 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:52:34.596322 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ef0f43ac-fd71-43ae-9213-9c3ab5f59161 could not be found. Jul 19 15:52:34.596322 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:52:34.598956 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-b17cd115-680f-4a0d-bd04-1546f239f24d tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Returning 404 to user: Instance ef0f43ac-fd71-43ae-9213-9c3ab5f59161 could not be found. {{(pid=129519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:52:34.598956 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-b17cd115-680f-4a0d-bd04-1546f239f24d tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/ef0f43ac-fd71-43ae-9213-9c3ab5f59161" status: 404 len: 111 microversion: 2.1 time: 0.030938 Jul 19 15:52:34.598956 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 460/972] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:52:34 2022] GET /compute/v2.1/servers/ef0f43ac-fd71-43ae-9213-9c3ab5f59161 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 15:52:37.846414 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-3f0d3656-7969-4006-8165-4cf98fdb1cc7 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:37.847962 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-3f0d3656-7969-4006-8165-4cf98fdb1cc7 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: d1382aa7-6d93-410a-94ae-a7944114573f] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:52:37.858495 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-3f0d3656-7969-4006-8165-4cf98fdb1cc7 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:37.859492 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-3f0d3656-7969-4006-8165-4cf98fdb1cc7 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:37.860548 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-3f0d3656-7969-4006-8165-4cf98fdb1cc7 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:37.861149 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-3f0d3656-7969-4006-8165-4cf98fdb1cc7 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:37.878979 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.wsgi [None req-3f0d3656-7969-4006-8165-4cf98fdb1cc7 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] HTTP exception thrown: Instance d1382aa7-6d93-410a-94ae-a7944114573f could not be found. Jul 19 15:52:37.880743 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-3f0d3656-7969-4006-8165-4cf98fdb1cc7 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Request method failure captured: Jul 19 15:52:37.880743 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: request: DELETE /compute/v2.1/servers/d1382aa7-6d93-410a-94ae-a7944114573f HTTP/1.1 Jul 19 15:52:37.880743 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Accept: application/json Jul 19 15:52:37.880743 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Accept-Encoding: identity Jul 19 15:52:37.880743 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Connection: close Jul 19 15:52:37.880743 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Content-Length: 0 Jul 19 15:52:37.880743 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Content-Type: application/json Jul 19 15:52:37.880743 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Host: 10.222.0.64 Jul 19 15:52:37.880743 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Openstack-System-Scope: None Jul 19 15:52:37.880743 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: User-Agent: python-urllib3/1.26.9 Jul 19 15:52:37.880743 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Auth-Token: gAAAAABi1tGPtVnrBLo0yCDS-Fxp117KmoW30EOrAzeE-HWJZTaOLzmdVU7ilJLT24AK1cNZoT6hZsY9VJG83Xk6FPFrebHG3s54Fuj7pMRO-j7b_NklvH50XPBLW-GpDpGZ3ebrTqCiTKXUJEZA0zlfYPmMdreiVMLme-IYyDlHVZle_DtpLr0 Jul 19 15:52:37.880743 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Domain-Id: None Jul 19 15:52:37.880743 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Domain-Name: None Jul 19 15:52:37.880743 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Identity-Status: Confirmed Jul 19 15:52:37.880743 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Is-Admin-Project: True Jul 19 15:52:37.880743 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Project-Domain-Id: default Jul 19 15:52:37.880743 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Project-Domain-Name: Default Jul 19 15:52:37.880743 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Project-Id: 45a72d232f314a78b0e1c3f04b0ed682 Jul 19 15:52:37.880743 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Project-Name: tempest-AttachVolumeNegativeTest-1922780758 Jul 19 15:52:37.880743 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Role: member,reader Jul 19 15:52:37.880743 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Roles: member,reader Jul 19 15:52:37.882643 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_45a72d232f314a78b0e1c3f04b0ed682", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/45a72d232f314a78b0e1c3f04b0ed682"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/45a72d232f314a78b0e1c3f04b0ed682"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/45a72d232f314a78b0e1c3f04b0ed682"}]}] Jul 19 15:52:37.882643 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Tenant: tempest-AttachVolumeNegativeTest-1922780758 Jul 19 15:52:37.882643 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Tenant-Id: 45a72d232f314a78b0e1c3f04b0ed682 Jul 19 15:52:37.882643 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1922780758 Jul 19 15:52:37.882643 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User: tempest-AttachVolumeNegativeTest-1922780758-project Jul 19 15:52:37.882643 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User-Domain-Id: default Jul 19 15:52:37.882643 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User-Domain-Name: Default Jul 19 15:52:37.882643 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User-Id: 2d7c42cf0bc84292bb0b7edb9f2e7fc3 Jul 19 15:52:37.882643 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User-Name: tempest-AttachVolumeNegativeTest-1922780758-project Jul 19 15:52:37.882643 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: method: > Jul 19 15:52:37.882643 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: exception: Instance d1382aa7-6d93-410a-94ae-a7944114573f could not be found. Jul 19 15:52:37.882643 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: action_args: {'id': 'd1382aa7-6d93-410a-94ae-a7944114573f'} Jul 19 15:52:37.883615 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:52:37.883615 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:52:37.883615 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 15:52:37.883615 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 15:52:37.883615 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 15:52:37.883615 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 15:52:37.883615 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 15:52:37.883615 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 15:52:37.883615 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 15:52:37.883615 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 15:52:37.883615 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1382aa7-6d93-410a-94ae-a7944114573f could not be found. Jul 19 15:52:37.883615 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:52:37.883615 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:52:37.883615 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:52:37.883615 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:52:37.883615 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:52:37.883615 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:52:37.883615 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:52:37.883615 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:52:37.883615 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:52:37.885113 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:52:37.885113 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 15:52:37.885113 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 15:52:37.885113 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 15:52:37.885113 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 15:52:37.885113 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 15:52:37.885113 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 15:52:37.885113 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 15:52:37.885113 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 15:52:37.885113 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1382aa7-6d93-410a-94ae-a7944114573f could not be found. Jul 19 15:52:37.885113 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:52:37.885113 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:52:37.885113 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:52:37.885113 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:52:37.885113 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:52:37.885113 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:52:37.885113 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:52:37.885113 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:52:37.885113 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1382aa7-6d93-410a-94ae-a7944114573f could not be found. Jul 19 15:52:37.885113 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:52:37.887187 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-3f0d3656-7969-4006-8165-4cf98fdb1cc7 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Returning 404 to user: Instance d1382aa7-6d93-410a-94ae-a7944114573f could not be found. {{(pid=129520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:52:37.887187 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-3f0d3656-7969-4006-8165-4cf98fdb1cc7 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "DELETE /compute/v2.1/servers/d1382aa7-6d93-410a-94ae-a7944114573f" status: 404 len: 111 microversion: 2.1 time: 0.051859 Jul 19 15:52:37.887957 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 513/973] 10.222.0.64 () {58 vars in 1238 bytes} [Tue Jul 19 15:52:37 2022] DELETE /compute/v2.1/servers/d1382aa7-6d93-410a-94ae-a7944114573f => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 15:52:37.900032 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-a0fb97bb-6970-4113-ad47-844f52a028ca tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:37.900773 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-a0fb97bb-6970-4113-ad47-844f52a028ca tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: d1382aa7-6d93-410a-94ae-a7944114573f] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:52:37.907701 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-a0fb97bb-6970-4113-ad47-844f52a028ca tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:37.908658 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-a0fb97bb-6970-4113-ad47-844f52a028ca tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:37.910078 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-a0fb97bb-6970-4113-ad47-844f52a028ca tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:37.911124 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-a0fb97bb-6970-4113-ad47-844f52a028ca tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:37.927981 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.wsgi [None req-a0fb97bb-6970-4113-ad47-844f52a028ca tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] HTTP exception thrown: Instance d1382aa7-6d93-410a-94ae-a7944114573f could not be found. Jul 19 15:52:37.929698 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-a0fb97bb-6970-4113-ad47-844f52a028ca tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Request method failure captured: Jul 19 15:52:37.929698 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: request: GET /compute/v2.1/servers/d1382aa7-6d93-410a-94ae-a7944114573f HTTP/1.1 Jul 19 15:52:37.929698 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Accept: application/json Jul 19 15:52:37.929698 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Accept-Encoding: identity Jul 19 15:52:37.929698 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Connection: close Jul 19 15:52:37.929698 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Content-Length: 0 Jul 19 15:52:37.929698 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Content-Type: application/json Jul 19 15:52:37.929698 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Host: 10.222.0.64 Jul 19 15:52:37.929698 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Openstack-System-Scope: None Jul 19 15:52:37.929698 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: User-Agent: python-urllib3/1.26.9 Jul 19 15:52:37.929698 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Auth-Token: gAAAAABi1tGPtVnrBLo0yCDS-Fxp117KmoW30EOrAzeE-HWJZTaOLzmdVU7ilJLT24AK1cNZoT6hZsY9VJG83Xk6FPFrebHG3s54Fuj7pMRO-j7b_NklvH50XPBLW-GpDpGZ3ebrTqCiTKXUJEZA0zlfYPmMdreiVMLme-IYyDlHVZle_DtpLr0 Jul 19 15:52:37.929698 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Domain-Id: None Jul 19 15:52:37.929698 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Domain-Name: None Jul 19 15:52:37.929698 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Identity-Status: Confirmed Jul 19 15:52:37.929698 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Is-Admin-Project: True Jul 19 15:52:37.929698 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Domain-Id: default Jul 19 15:52:37.929698 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Domain-Name: Default Jul 19 15:52:37.929698 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Id: 45a72d232f314a78b0e1c3f04b0ed682 Jul 19 15:52:37.929698 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Name: tempest-AttachVolumeNegativeTest-1922780758 Jul 19 15:52:37.929698 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Role: member,reader Jul 19 15:52:37.929698 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Roles: member,reader Jul 19 15:52:37.931075 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_45a72d232f314a78b0e1c3f04b0ed682", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/45a72d232f314a78b0e1c3f04b0ed682"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/45a72d232f314a78b0e1c3f04b0ed682"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/45a72d232f314a78b0e1c3f04b0ed682"}]}] Jul 19 15:52:37.931075 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Tenant: tempest-AttachVolumeNegativeTest-1922780758 Jul 19 15:52:37.931075 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Tenant-Id: 45a72d232f314a78b0e1c3f04b0ed682 Jul 19 15:52:37.931075 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1922780758 Jul 19 15:52:37.931075 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User: tempest-AttachVolumeNegativeTest-1922780758-project Jul 19 15:52:37.931075 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Domain-Id: default Jul 19 15:52:37.931075 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Domain-Name: Default Jul 19 15:52:37.931075 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Id: 2d7c42cf0bc84292bb0b7edb9f2e7fc3 Jul 19 15:52:37.931075 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Name: tempest-AttachVolumeNegativeTest-1922780758-project Jul 19 15:52:37.931075 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: method: > Jul 19 15:52:37.931075 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: exception: Instance d1382aa7-6d93-410a-94ae-a7944114573f could not be found. Jul 19 15:52:37.931075 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: action_args: {'id': 'd1382aa7-6d93-410a-94ae-a7944114573f'} Jul 19 15:52:37.931797 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:52:37.931797 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:52:37.931797 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 15:52:37.931797 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 15:52:37.931797 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 15:52:37.931797 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 15:52:37.931797 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 15:52:37.931797 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 15:52:37.931797 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 15:52:37.931797 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 15:52:37.931797 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d1382aa7-6d93-410a-94ae-a7944114573f could not be found. Jul 19 15:52:37.931797 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:52:37.931797 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:52:37.931797 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:52:37.931797 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:52:37.931797 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:52:37.931797 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:52:37.931797 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:52:37.931797 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:52:37.931797 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:52:37.932985 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:52:37.932985 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 15:52:37.932985 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 15:52:37.932985 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 15:52:37.932985 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 15:52:37.932985 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 15:52:37.932985 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 15:52:37.932985 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d1382aa7-6d93-410a-94ae-a7944114573f could not be found. Jul 19 15:52:37.932985 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:52:37.932985 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:52:37.932985 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:52:37.932985 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:52:37.932985 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:52:37.932985 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:52:37.932985 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:52:37.932985 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:52:37.932985 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d1382aa7-6d93-410a-94ae-a7944114573f could not be found. Jul 19 15:52:37.932985 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:52:37.934390 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-a0fb97bb-6970-4113-ad47-844f52a028ca tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Returning 404 to user: Instance d1382aa7-6d93-410a-94ae-a7944114573f could not be found. {{(pid=129519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:52:37.934390 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-a0fb97bb-6970-4113-ad47-844f52a028ca tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/d1382aa7-6d93-410a-94ae-a7944114573f" status: 404 len: 111 microversion: 2.1 time: 0.040200 Jul 19 15:52:37.934390 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 461/974] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:52:37 2022] GET /compute/v2.1/servers/d1382aa7-6d93-410a-94ae-a7944114573f => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 15:52:37.941565 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-01f803ef-8d45-4ba8-a1b5-a8f6c342aa55 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:37.942075 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-01f803ef-8d45-4ba8-a1b5-a8f6c342aa55 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: 78bc17d6-5509-446d-a843-99a70b397128] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:52:37.948114 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-01f803ef-8d45-4ba8-a1b5-a8f6c342aa55 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:37.948562 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-01f803ef-8d45-4ba8-a1b5-a8f6c342aa55 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:37.949328 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-01f803ef-8d45-4ba8-a1b5-a8f6c342aa55 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:37.949752 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-01f803ef-8d45-4ba8-a1b5-a8f6c342aa55 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:37.964777 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.wsgi [None req-01f803ef-8d45-4ba8-a1b5-a8f6c342aa55 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] HTTP exception thrown: Instance 78bc17d6-5509-446d-a843-99a70b397128 could not be found. Jul 19 15:52:37.966322 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-01f803ef-8d45-4ba8-a1b5-a8f6c342aa55 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Request method failure captured: Jul 19 15:52:37.966322 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: request: DELETE /compute/v2.1/servers/78bc17d6-5509-446d-a843-99a70b397128 HTTP/1.1 Jul 19 15:52:37.966322 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Accept: application/json Jul 19 15:52:37.966322 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Accept-Encoding: identity Jul 19 15:52:37.966322 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Connection: close Jul 19 15:52:37.966322 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Content-Length: 0 Jul 19 15:52:37.966322 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Content-Type: application/json Jul 19 15:52:37.966322 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Host: 10.222.0.64 Jul 19 15:52:37.966322 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Openstack-System-Scope: None Jul 19 15:52:37.966322 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: User-Agent: python-urllib3/1.26.9 Jul 19 15:52:37.966322 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Auth-Token: gAAAAABi1tGPtVnrBLo0yCDS-Fxp117KmoW30EOrAzeE-HWJZTaOLzmdVU7ilJLT24AK1cNZoT6hZsY9VJG83Xk6FPFrebHG3s54Fuj7pMRO-j7b_NklvH50XPBLW-GpDpGZ3ebrTqCiTKXUJEZA0zlfYPmMdreiVMLme-IYyDlHVZle_DtpLr0 Jul 19 15:52:37.966322 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Domain-Id: None Jul 19 15:52:37.966322 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Domain-Name: None Jul 19 15:52:37.966322 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Identity-Status: Confirmed Jul 19 15:52:37.966322 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Is-Admin-Project: True Jul 19 15:52:37.966322 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Project-Domain-Id: default Jul 19 15:52:37.966322 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Project-Domain-Name: Default Jul 19 15:52:37.966322 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Project-Id: 45a72d232f314a78b0e1c3f04b0ed682 Jul 19 15:52:37.966322 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Project-Name: tempest-AttachVolumeNegativeTest-1922780758 Jul 19 15:52:37.966322 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Role: member,reader Jul 19 15:52:37.966322 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Roles: member,reader Jul 19 15:52:37.967938 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_45a72d232f314a78b0e1c3f04b0ed682", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/45a72d232f314a78b0e1c3f04b0ed682"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/45a72d232f314a78b0e1c3f04b0ed682"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/45a72d232f314a78b0e1c3f04b0ed682"}]}] Jul 19 15:52:37.967938 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Tenant: tempest-AttachVolumeNegativeTest-1922780758 Jul 19 15:52:37.967938 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Tenant-Id: 45a72d232f314a78b0e1c3f04b0ed682 Jul 19 15:52:37.967938 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1922780758 Jul 19 15:52:37.967938 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User: tempest-AttachVolumeNegativeTest-1922780758-project Jul 19 15:52:37.967938 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User-Domain-Id: default Jul 19 15:52:37.967938 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User-Domain-Name: Default Jul 19 15:52:37.967938 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User-Id: 2d7c42cf0bc84292bb0b7edb9f2e7fc3 Jul 19 15:52:37.967938 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User-Name: tempest-AttachVolumeNegativeTest-1922780758-project Jul 19 15:52:37.967938 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: method: > Jul 19 15:52:37.967938 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: exception: Instance 78bc17d6-5509-446d-a843-99a70b397128 could not be found. Jul 19 15:52:37.967938 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: action_args: {'id': '78bc17d6-5509-446d-a843-99a70b397128'} Jul 19 15:52:37.969119 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:52:37.969119 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:52:37.969119 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 15:52:37.969119 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 15:52:37.969119 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 15:52:37.969119 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 15:52:37.969119 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 15:52:37.969119 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 15:52:37.969119 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 15:52:37.969119 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 15:52:37.969119 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78bc17d6-5509-446d-a843-99a70b397128 could not be found. Jul 19 15:52:37.969119 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:52:37.969119 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:52:37.969119 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:52:37.969119 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:52:37.969119 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:52:37.969119 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:52:37.969119 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:52:37.969119 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:52:37.969119 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:52:37.975747 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:52:37.975747 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 15:52:37.975747 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 15:52:37.975747 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 15:52:37.975747 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 15:52:37.975747 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 15:52:37.975747 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 15:52:37.975747 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 15:52:37.975747 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 15:52:37.975747 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78bc17d6-5509-446d-a843-99a70b397128 could not be found. Jul 19 15:52:37.975747 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:52:37.975747 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:52:37.975747 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:52:37.975747 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:52:37.975747 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:52:37.975747 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:52:37.975747 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:52:37.975747 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:52:37.975747 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78bc17d6-5509-446d-a843-99a70b397128 could not be found. Jul 19 15:52:37.975747 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:52:37.978542 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-01f803ef-8d45-4ba8-a1b5-a8f6c342aa55 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Returning 404 to user: Instance 78bc17d6-5509-446d-a843-99a70b397128 could not be found. {{(pid=129520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:52:37.978542 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-01f803ef-8d45-4ba8-a1b5-a8f6c342aa55 tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "DELETE /compute/v2.1/servers/78bc17d6-5509-446d-a843-99a70b397128" status: 404 len: 111 microversion: 2.1 time: 0.030613 Jul 19 15:52:37.978542 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 514/975] 10.222.0.64 () {58 vars in 1238 bytes} [Tue Jul 19 15:52:37 2022] DELETE /compute/v2.1/servers/78bc17d6-5509-446d-a843-99a70b397128 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 15:52:37.993041 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-f40de235-a4de-4fc8-9ff8-273e8548c4ba tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:37.993740 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-f40de235-a4de-4fc8-9ff8-273e8548c4ba tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: 78bc17d6-5509-446d-a843-99a70b397128] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:52:38.000091 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-f40de235-a4de-4fc8-9ff8-273e8548c4ba tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:38.000543 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-f40de235-a4de-4fc8-9ff8-273e8548c4ba tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:38.001343 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-f40de235-a4de-4fc8-9ff8-273e8548c4ba tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:38.001794 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-f40de235-a4de-4fc8-9ff8-273e8548c4ba tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:38.016107 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.wsgi [None req-f40de235-a4de-4fc8-9ff8-273e8548c4ba tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] HTTP exception thrown: Instance 78bc17d6-5509-446d-a843-99a70b397128 could not be found. Jul 19 15:52:38.017628 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-f40de235-a4de-4fc8-9ff8-273e8548c4ba tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Request method failure captured: Jul 19 15:52:38.017628 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: request: GET /compute/v2.1/servers/78bc17d6-5509-446d-a843-99a70b397128 HTTP/1.1 Jul 19 15:52:38.017628 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Accept: application/json Jul 19 15:52:38.017628 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Accept-Encoding: identity Jul 19 15:52:38.017628 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Connection: close Jul 19 15:52:38.017628 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Content-Length: 0 Jul 19 15:52:38.017628 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Content-Type: application/json Jul 19 15:52:38.017628 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Host: 10.222.0.64 Jul 19 15:52:38.017628 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Openstack-System-Scope: None Jul 19 15:52:38.017628 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: User-Agent: python-urllib3/1.26.9 Jul 19 15:52:38.017628 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Auth-Token: gAAAAABi1tGPtVnrBLo0yCDS-Fxp117KmoW30EOrAzeE-HWJZTaOLzmdVU7ilJLT24AK1cNZoT6hZsY9VJG83Xk6FPFrebHG3s54Fuj7pMRO-j7b_NklvH50XPBLW-GpDpGZ3ebrTqCiTKXUJEZA0zlfYPmMdreiVMLme-IYyDlHVZle_DtpLr0 Jul 19 15:52:38.017628 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Domain-Id: None Jul 19 15:52:38.017628 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Domain-Name: None Jul 19 15:52:38.017628 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Identity-Status: Confirmed Jul 19 15:52:38.017628 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Is-Admin-Project: True Jul 19 15:52:38.017628 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Domain-Id: default Jul 19 15:52:38.017628 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Domain-Name: Default Jul 19 15:52:38.017628 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Id: 45a72d232f314a78b0e1c3f04b0ed682 Jul 19 15:52:38.017628 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Name: tempest-AttachVolumeNegativeTest-1922780758 Jul 19 15:52:38.017628 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Role: member,reader Jul 19 15:52:38.017628 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Roles: member,reader Jul 19 15:52:38.020741 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_45a72d232f314a78b0e1c3f04b0ed682", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/45a72d232f314a78b0e1c3f04b0ed682"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/45a72d232f314a78b0e1c3f04b0ed682"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/45a72d232f314a78b0e1c3f04b0ed682"}]}] Jul 19 15:52:38.020741 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Tenant: tempest-AttachVolumeNegativeTest-1922780758 Jul 19 15:52:38.020741 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Tenant-Id: 45a72d232f314a78b0e1c3f04b0ed682 Jul 19 15:52:38.020741 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1922780758 Jul 19 15:52:38.020741 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User: tempest-AttachVolumeNegativeTest-1922780758-project Jul 19 15:52:38.020741 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Domain-Id: default Jul 19 15:52:38.020741 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Domain-Name: Default Jul 19 15:52:38.020741 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Id: 2d7c42cf0bc84292bb0b7edb9f2e7fc3 Jul 19 15:52:38.020741 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Name: tempest-AttachVolumeNegativeTest-1922780758-project Jul 19 15:52:38.020741 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: method: > Jul 19 15:52:38.020741 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: exception: Instance 78bc17d6-5509-446d-a843-99a70b397128 could not be found. Jul 19 15:52:38.020741 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: action_args: {'id': '78bc17d6-5509-446d-a843-99a70b397128'} Jul 19 15:52:38.021525 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:52:38.021525 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:52:38.021525 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 15:52:38.021525 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 15:52:38.021525 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 15:52:38.021525 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 15:52:38.021525 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 15:52:38.021525 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 15:52:38.021525 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 15:52:38.021525 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 15:52:38.021525 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 78bc17d6-5509-446d-a843-99a70b397128 could not be found. Jul 19 15:52:38.021525 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:52:38.021525 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:52:38.021525 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:52:38.021525 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:52:38.021525 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:52:38.021525 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:52:38.021525 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:52:38.021525 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:52:38.021525 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:52:38.023715 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:52:38.023715 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 15:52:38.023715 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 15:52:38.023715 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 15:52:38.023715 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 15:52:38.023715 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 15:52:38.023715 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 15:52:38.023715 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 78bc17d6-5509-446d-a843-99a70b397128 could not be found. Jul 19 15:52:38.023715 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:52:38.023715 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:52:38.023715 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:52:38.023715 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:52:38.023715 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:52:38.023715 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:52:38.023715 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:52:38.023715 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:52:38.023715 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 78bc17d6-5509-446d-a843-99a70b397128 could not be found. Jul 19 15:52:38.023715 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:52:38.026184 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-f40de235-a4de-4fc8-9ff8-273e8548c4ba tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Returning 404 to user: Instance 78bc17d6-5509-446d-a843-99a70b397128 could not be found. {{(pid=129519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:52:38.026184 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-f40de235-a4de-4fc8-9ff8-273e8548c4ba tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/78bc17d6-5509-446d-a843-99a70b397128" status: 404 len: 111 microversion: 2.1 time: 0.030742 Jul 19 15:52:38.026184 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 462/976] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:52:37 2022] GET /compute/v2.1/servers/78bc17d6-5509-446d-a843-99a70b397128 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 15:52:39.190029 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-395e049b-868a-4c1a-a75d-026c03e4f23b tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:39.190858 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-395e049b-868a-4c1a-a75d-026c03e4f23b tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: 5f1579c0-907a-490f-ad8e-0fe2db0baf97] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:52:39.198142 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-395e049b-868a-4c1a-a75d-026c03e4f23b tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:39.198706 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-395e049b-868a-4c1a-a75d-026c03e4f23b tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:39.199568 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-395e049b-868a-4c1a-a75d-026c03e4f23b tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:39.200428 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-395e049b-868a-4c1a-a75d-026c03e4f23b tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:39.217842 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.wsgi [None req-395e049b-868a-4c1a-a75d-026c03e4f23b tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] HTTP exception thrown: Instance 5f1579c0-907a-490f-ad8e-0fe2db0baf97 could not be found. Jul 19 15:52:39.219479 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-395e049b-868a-4c1a-a75d-026c03e4f23b tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Request method failure captured: Jul 19 15:52:39.219479 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: request: DELETE /compute/v2.1/servers/5f1579c0-907a-490f-ad8e-0fe2db0baf97 HTTP/1.1 Jul 19 15:52:39.219479 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Accept: application/json Jul 19 15:52:39.219479 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Accept-Encoding: identity Jul 19 15:52:39.219479 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Connection: close Jul 19 15:52:39.219479 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Content-Length: 0 Jul 19 15:52:39.219479 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Content-Type: application/json Jul 19 15:52:39.219479 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Host: 10.222.0.64 Jul 19 15:52:39.219479 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Openstack-System-Scope: None Jul 19 15:52:39.219479 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: User-Agent: python-urllib3/1.26.9 Jul 19 15:52:39.219479 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Auth-Token: gAAAAABi1tGPtVnrBLo0yCDS-Fxp117KmoW30EOrAzeE-HWJZTaOLzmdVU7ilJLT24AK1cNZoT6hZsY9VJG83Xk6FPFrebHG3s54Fuj7pMRO-j7b_NklvH50XPBLW-GpDpGZ3ebrTqCiTKXUJEZA0zlfYPmMdreiVMLme-IYyDlHVZle_DtpLr0 Jul 19 15:52:39.219479 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Domain-Id: None Jul 19 15:52:39.219479 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Domain-Name: None Jul 19 15:52:39.219479 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Identity-Status: Confirmed Jul 19 15:52:39.219479 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Is-Admin-Project: True Jul 19 15:52:39.219479 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Project-Domain-Id: default Jul 19 15:52:39.219479 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Project-Domain-Name: Default Jul 19 15:52:39.219479 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Project-Id: 45a72d232f314a78b0e1c3f04b0ed682 Jul 19 15:52:39.219479 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Project-Name: tempest-AttachVolumeNegativeTest-1922780758 Jul 19 15:52:39.219479 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Role: member,reader Jul 19 15:52:39.219479 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Roles: member,reader Jul 19 15:52:39.220805 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_45a72d232f314a78b0e1c3f04b0ed682", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/45a72d232f314a78b0e1c3f04b0ed682"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/45a72d232f314a78b0e1c3f04b0ed682"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/45a72d232f314a78b0e1c3f04b0ed682"}]}] Jul 19 15:52:39.220805 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Tenant: tempest-AttachVolumeNegativeTest-1922780758 Jul 19 15:52:39.220805 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Tenant-Id: 45a72d232f314a78b0e1c3f04b0ed682 Jul 19 15:52:39.220805 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1922780758 Jul 19 15:52:39.220805 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User: tempest-AttachVolumeNegativeTest-1922780758-project Jul 19 15:52:39.220805 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User-Domain-Id: default Jul 19 15:52:39.220805 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User-Domain-Name: Default Jul 19 15:52:39.220805 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User-Id: 2d7c42cf0bc84292bb0b7edb9f2e7fc3 Jul 19 15:52:39.220805 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User-Name: tempest-AttachVolumeNegativeTest-1922780758-project Jul 19 15:52:39.220805 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: method: > Jul 19 15:52:39.220805 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: exception: Instance 5f1579c0-907a-490f-ad8e-0fe2db0baf97 could not be found. Jul 19 15:52:39.220805 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: action_args: {'id': '5f1579c0-907a-490f-ad8e-0fe2db0baf97'} Jul 19 15:52:39.221636 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:52:39.221636 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:52:39.221636 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 15:52:39.221636 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 15:52:39.221636 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 15:52:39.221636 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 15:52:39.221636 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 15:52:39.221636 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 15:52:39.221636 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 15:52:39.221636 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 15:52:39.221636 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f1579c0-907a-490f-ad8e-0fe2db0baf97 could not be found. Jul 19 15:52:39.221636 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:52:39.221636 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:52:39.221636 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:52:39.221636 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:52:39.221636 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:52:39.221636 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:52:39.221636 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:52:39.221636 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:52:39.221636 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:52:39.223875 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:52:39.223875 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 15:52:39.223875 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 15:52:39.223875 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 15:52:39.223875 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 15:52:39.223875 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 15:52:39.223875 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 15:52:39.223875 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 15:52:39.223875 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 15:52:39.223875 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f1579c0-907a-490f-ad8e-0fe2db0baf97 could not be found. Jul 19 15:52:39.223875 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:52:39.223875 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:52:39.223875 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:52:39.223875 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:52:39.223875 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:52:39.223875 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:52:39.223875 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:52:39.223875 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:52:39.223875 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f1579c0-907a-490f-ad8e-0fe2db0baf97 could not be found. Jul 19 15:52:39.223875 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:52:39.226633 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-395e049b-868a-4c1a-a75d-026c03e4f23b tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Returning 404 to user: Instance 5f1579c0-907a-490f-ad8e-0fe2db0baf97 could not be found. {{(pid=129520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:52:39.226633 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-395e049b-868a-4c1a-a75d-026c03e4f23b tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "DELETE /compute/v2.1/servers/5f1579c0-907a-490f-ad8e-0fe2db0baf97" status: 404 len: 111 microversion: 2.1 time: 0.035397 Jul 19 15:52:39.226633 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 515/977] 10.222.0.64 () {58 vars in 1238 bytes} [Tue Jul 19 15:52:39 2022] DELETE /compute/v2.1/servers/5f1579c0-907a-490f-ad8e-0fe2db0baf97 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 15:52:39.229995 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-6ceb519e-53b2-49d4-be8e-0ca942cf086b tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:52:39.230641 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-6ceb519e-53b2-49d4-be8e-0ca942cf086b tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] [instance: 5f1579c0-907a-490f-ad8e-0fe2db0baf97] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:52:39.237222 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-6ceb519e-53b2-49d4-be8e-0ca942cf086b tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:39.238126 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-6ceb519e-53b2-49d4-be8e-0ca942cf086b tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:39.238490 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-6ceb519e-53b2-49d4-be8e-0ca942cf086b tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:52:39.238935 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-6ceb519e-53b2-49d4-be8e-0ca942cf086b tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:52:39.253599 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.wsgi [None req-6ceb519e-53b2-49d4-be8e-0ca942cf086b tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] HTTP exception thrown: Instance 5f1579c0-907a-490f-ad8e-0fe2db0baf97 could not be found. Jul 19 15:52:39.255300 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-6ceb519e-53b2-49d4-be8e-0ca942cf086b tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Request method failure captured: Jul 19 15:52:39.255300 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: request: GET /compute/v2.1/servers/5f1579c0-907a-490f-ad8e-0fe2db0baf97 HTTP/1.1 Jul 19 15:52:39.255300 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Accept: application/json Jul 19 15:52:39.255300 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Accept-Encoding: identity Jul 19 15:52:39.255300 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Connection: close Jul 19 15:52:39.255300 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Content-Length: 0 Jul 19 15:52:39.255300 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Content-Type: application/json Jul 19 15:52:39.255300 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Host: 10.222.0.64 Jul 19 15:52:39.255300 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Openstack-System-Scope: None Jul 19 15:52:39.255300 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: User-Agent: python-urllib3/1.26.9 Jul 19 15:52:39.255300 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Auth-Token: gAAAAABi1tGPtVnrBLo0yCDS-Fxp117KmoW30EOrAzeE-HWJZTaOLzmdVU7ilJLT24AK1cNZoT6hZsY9VJG83Xk6FPFrebHG3s54Fuj7pMRO-j7b_NklvH50XPBLW-GpDpGZ3ebrTqCiTKXUJEZA0zlfYPmMdreiVMLme-IYyDlHVZle_DtpLr0 Jul 19 15:52:39.255300 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Domain-Id: None Jul 19 15:52:39.255300 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Domain-Name: None Jul 19 15:52:39.255300 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Identity-Status: Confirmed Jul 19 15:52:39.255300 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Is-Admin-Project: True Jul 19 15:52:39.255300 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Domain-Id: default Jul 19 15:52:39.255300 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Domain-Name: Default Jul 19 15:52:39.255300 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Id: 45a72d232f314a78b0e1c3f04b0ed682 Jul 19 15:52:39.255300 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Name: tempest-AttachVolumeNegativeTest-1922780758 Jul 19 15:52:39.255300 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Role: member,reader Jul 19 15:52:39.255300 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Roles: member,reader Jul 19 15:52:39.256680 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_45a72d232f314a78b0e1c3f04b0ed682", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/45a72d232f314a78b0e1c3f04b0ed682"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/45a72d232f314a78b0e1c3f04b0ed682"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/45a72d232f314a78b0e1c3f04b0ed682"}]}] Jul 19 15:52:39.256680 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Tenant: tempest-AttachVolumeNegativeTest-1922780758 Jul 19 15:52:39.256680 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Tenant-Id: 45a72d232f314a78b0e1c3f04b0ed682 Jul 19 15:52:39.256680 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1922780758 Jul 19 15:52:39.256680 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User: tempest-AttachVolumeNegativeTest-1922780758-project Jul 19 15:52:39.256680 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Domain-Id: default Jul 19 15:52:39.256680 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Domain-Name: Default Jul 19 15:52:39.256680 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Id: 2d7c42cf0bc84292bb0b7edb9f2e7fc3 Jul 19 15:52:39.256680 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Name: tempest-AttachVolumeNegativeTest-1922780758-project Jul 19 15:52:39.256680 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: method: > Jul 19 15:52:39.256680 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: exception: Instance 5f1579c0-907a-490f-ad8e-0fe2db0baf97 could not be found. Jul 19 15:52:39.256680 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: action_args: {'id': '5f1579c0-907a-490f-ad8e-0fe2db0baf97'} Jul 19 15:52:39.257431 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:52:39.257431 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:52:39.257431 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 15:52:39.257431 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 15:52:39.257431 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 15:52:39.257431 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 15:52:39.257431 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 15:52:39.257431 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 15:52:39.257431 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 15:52:39.257431 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 15:52:39.257431 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5f1579c0-907a-490f-ad8e-0fe2db0baf97 could not be found. Jul 19 15:52:39.257431 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:52:39.257431 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:52:39.257431 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:52:39.257431 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:52:39.257431 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:52:39.257431 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:52:39.257431 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:52:39.257431 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:52:39.257431 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:52:39.258804 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:52:39.258804 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 15:52:39.258804 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 15:52:39.258804 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 15:52:39.258804 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 15:52:39.258804 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 15:52:39.258804 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 15:52:39.258804 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5f1579c0-907a-490f-ad8e-0fe2db0baf97 could not be found. Jul 19 15:52:39.258804 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:52:39.258804 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:52:39.258804 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:52:39.258804 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:52:39.258804 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:52:39.258804 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:52:39.258804 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:52:39.258804 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:52:39.258804 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5f1579c0-907a-490f-ad8e-0fe2db0baf97 could not be found. Jul 19 15:52:39.258804 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:52:39.260127 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-6ceb519e-53b2-49d4-be8e-0ca942cf086b tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] Returning 404 to user: Instance 5f1579c0-907a-490f-ad8e-0fe2db0baf97 could not be found. {{(pid=129519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:52:39.260127 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-6ceb519e-53b2-49d4-be8e-0ca942cf086b tempest-AttachVolumeNegativeTest-1922780758 tempest-AttachVolumeNegativeTest-1922780758-project] 10.222.0.64 "GET /compute/v2.1/servers/5f1579c0-907a-490f-ad8e-0fe2db0baf97" status: 404 len: 111 microversion: 2.1 time: 0.030537 Jul 19 15:52:39.266513 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 463/978] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:52:39 2022] GET /compute/v2.1/servers/5f1579c0-907a-490f-ad8e-0fe2db0baf97 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 15:53:14.750590 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-f1cd274b-55aa-42bd-ac50-626963384a33 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-864246367", "imageRef": "15012099-fe38-45ac-bd33-d884a5ba65f2", "flavorRef": "452", "networks": [{"uuid": "7a7ccfd1-db0e-4890-9655-b5260413649d"}]}} {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:53:14.758598 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG dbcounter [-] [129520] Writing DB stats nova_api:SELECT=28,nova_api:DELETE=1 {{(pid=129520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:53:14.759374 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG dbcounter [-] [129520] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:53:14.813101 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.network.neutron [None req-f1cd274b-55aa-42bd-ac50-626963384a33 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] validate_networks() for [('7a7ccfd1-db0e-4890-9655-b5260413649d', None, None, None, None, None)] {{(pid=129520) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 15:53:15.198526 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.virt.hardware [None req-f1cd274b-55aa-42bd-ac50-626963384a33 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Flavor limits 0:0:0 {{(pid=129520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 15:53:15.198941 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.virt.hardware [None req-f1cd274b-55aa-42bd-ac50-626963384a33 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Image limits 0:0:0 {{(pid=129520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 15:53:15.199428 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.virt.hardware [None req-f1cd274b-55aa-42bd-ac50-626963384a33 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Flavor pref 0:0:0 {{(pid=129520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 15:53:15.199808 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.virt.hardware [None req-f1cd274b-55aa-42bd-ac50-626963384a33 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Image pref 0:0:0 {{(pid=129520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 15:53:15.200387 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.virt.hardware [None req-f1cd274b-55aa-42bd-ac50-626963384a33 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 15:53:15.211915 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-f1cd274b-55aa-42bd-ac50-626963384a33 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:15.212358 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-f1cd274b-55aa-42bd-ac50-626963384a33 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:15.213150 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-f1cd274b-55aa-42bd-ac50-626963384a33 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:15.213584 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-f1cd274b-55aa-42bd-ac50-626963384a33 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:15.234410 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.quota [None req-f1cd274b-55aa-42bd-ac50-626963384a33 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Getting quotas for project 628680bdad9c4d2ebcb019bb40053ccc. Resources: {'ram', 'instances', 'cores'} {{(pid=129520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 15:53:15.239336 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.quota [None req-f1cd274b-55aa-42bd-ac50-626963384a33 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Getting quotas for user 7edc2b1d056341aaa31751f77cd03a2c and project 628680bdad9c4d2ebcb019bb40053ccc. Resources: {'ram', 'instances', 'cores'} {{(pid=129520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 15:53:15.251025 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-f1cd274b-55aa-42bd-ac50-626963384a33 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Going to run 1 instances... {{(pid=129520) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 15:53:15.253603 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-f1cd274b-55aa-42bd-ac50-626963384a33 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] [instance: 4118df58-62f2-461f-a818-3e9d7fbf962e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='15012099-fe38-45ac-bd33-d884a5ba65f2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 15:53:15.304294 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-f1cd274b-55aa-42bd-ac50-626963384a33 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.557669 Jul 19 15:53:15.310043 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 516/979] 10.222.0.64 () {60 vars in 1146 bytes} [Tue Jul 19 15:53:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 559 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 15:53:15.315401 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-cd033021-2c79-4eb2-b7a2-a4a0065d1c54 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:15.316977 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-cd033021-2c79-4eb2-b7a2-a4a0065d1c54 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] [instance: 4118df58-62f2-461f-a818-3e9d7fbf962e] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:15.319747 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG dbcounter [-] [129519] Writing DB stats nova_api:SELECT=31,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=129519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:53:15.321622 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG dbcounter [-] [129519] Writing DB stats nova_cell1:SELECT=19 {{(pid=129519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:53:15.496564 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-cd033021-2c79-4eb2-b7a2-a4a0065d1c54 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7edc2b1d056341aaa31751f77cd03a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628680bdad9c4d2ebcb019bb40053ccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:15.505548 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-cd033021-2c79-4eb2-b7a2-a4a0065d1c54 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] 10.222.0.64 "GET /compute/v2.1/servers/4118df58-62f2-461f-a818-3e9d7fbf962e" status: 200 len: 1213 microversion: 2.1 time: 0.193959 Jul 19 15:53:15.506264 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 464/980] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:15 2022] GET /compute/v2.1/servers/4118df58-62f2-461f-a818-3e9d7fbf962e => generated 1213 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:16.525952 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-8ddb8912-5e56-4aa9-abad-d3941ea6aa8d tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:16.526713 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-8ddb8912-5e56-4aa9-abad-d3941ea6aa8d tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] [instance: 4118df58-62f2-461f-a818-3e9d7fbf962e] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:16.537147 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-8ddb8912-5e56-4aa9-abad-d3941ea6aa8d tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:16.537716 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-8ddb8912-5e56-4aa9-abad-d3941ea6aa8d tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:16.539151 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-8ddb8912-5e56-4aa9-abad-d3941ea6aa8d tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:16.539841 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-8ddb8912-5e56-4aa9-abad-d3941ea6aa8d tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:16.628314 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-8ddb8912-5e56-4aa9-abad-d3941ea6aa8d tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7edc2b1d056341aaa31751f77cd03a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628680bdad9c4d2ebcb019bb40053ccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:16.637365 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-8ddb8912-5e56-4aa9-abad-d3941ea6aa8d tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] 10.222.0.64 "GET /compute/v2.1/servers/4118df58-62f2-461f-a818-3e9d7fbf962e" status: 200 len: 1271 microversion: 2.1 time: 0.118520 Jul 19 15:53:16.638251 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 517/981] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:16 2022] GET /compute/v2.1/servers/4118df58-62f2-461f-a818-3e9d7fbf962e => generated 1271 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:17.656207 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-010ddc3d-e3fd-486d-b15b-79aa785ac0af tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:17.656931 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-010ddc3d-e3fd-486d-b15b-79aa785ac0af tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] [instance: 4118df58-62f2-461f-a818-3e9d7fbf962e] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:17.663710 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-010ddc3d-e3fd-486d-b15b-79aa785ac0af tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:17.664169 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-010ddc3d-e3fd-486d-b15b-79aa785ac0af tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:17.664940 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-010ddc3d-e3fd-486d-b15b-79aa785ac0af tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:17.665409 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-010ddc3d-e3fd-486d-b15b-79aa785ac0af tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:17.819143 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-010ddc3d-e3fd-486d-b15b-79aa785ac0af tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7edc2b1d056341aaa31751f77cd03a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628680bdad9c4d2ebcb019bb40053ccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:17.827364 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-010ddc3d-e3fd-486d-b15b-79aa785ac0af tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] 10.222.0.64 "GET /compute/v2.1/servers/4118df58-62f2-461f-a818-3e9d7fbf962e" status: 200 len: 1313 microversion: 2.1 time: 0.175472 Jul 19 15:53:17.828026 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 465/982] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:17 2022] GET /compute/v2.1/servers/4118df58-62f2-461f-a818-3e9d7fbf962e => generated 1313 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:18.844624 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-3b7ab3e0-cd42-42cc-93d0-f0cf36f28634 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:18.845240 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-3b7ab3e0-cd42-42cc-93d0-f0cf36f28634 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] [instance: 4118df58-62f2-461f-a818-3e9d7fbf962e] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:18.852743 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-3b7ab3e0-cd42-42cc-93d0-f0cf36f28634 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:18.853222 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-3b7ab3e0-cd42-42cc-93d0-f0cf36f28634 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:18.854008 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-3b7ab3e0-cd42-42cc-93d0-f0cf36f28634 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:18.854479 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-3b7ab3e0-cd42-42cc-93d0-f0cf36f28634 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:19.196735 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-3b7ab3e0-cd42-42cc-93d0-f0cf36f28634 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7edc2b1d056341aaa31751f77cd03a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628680bdad9c4d2ebcb019bb40053ccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:19.204619 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-3b7ab3e0-cd42-42cc-93d0-f0cf36f28634 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] 10.222.0.64 "GET /compute/v2.1/servers/4118df58-62f2-461f-a818-3e9d7fbf962e" status: 200 len: 1313 microversion: 2.1 time: 0.363924 Jul 19 15:53:19.205199 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 518/983] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:18 2022] GET /compute/v2.1/servers/4118df58-62f2-461f-a818-3e9d7fbf962e => generated 1313 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:19.863924 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [req-46097543-f4c3-4960-8a45-e2fd873696b4 req-3091dbfd-9754-49b5-abd1-a15310527656 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4118df58-62f2-461f-a818-3e9d7fbf962e", "tag": "8661d5ec-05b5-4728-8464-6dfdedc3ac94"}]} {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:53:19.886494 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [req-46097543-f4c3-4960-8a45-e2fd873696b4 req-3091dbfd-9754-49b5-abd1-a15310527656 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:19.886978 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [req-46097543-f4c3-4960-8a45-e2fd873696b4 req-3091dbfd-9754-49b5-abd1-a15310527656 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:19.913687 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.compute.server_external_events [req-46097543-f4c3-4960-8a45-e2fd873696b4 req-3091dbfd-9754-49b5-abd1-a15310527656 service nova] Creating event network-changed:8661d5ec-05b5-4728-8464-6dfdedc3ac94 for instance 4118df58-62f2-461f-a818-3e9d7fbf962e on hv-cinder-84902 Jul 19 15:53:19.943439 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [req-46097543-f4c3-4960-8a45-e2fd873696b4 req-3091dbfd-9754-49b5-abd1-a15310527656 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073785 Jul 19 15:53:19.944108 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 466/984] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Jul 19 15:53:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:53:20.222092 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-1c0a7ca2-1929-4ecb-b98c-681788bdfe4d tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:20.222727 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-1c0a7ca2-1929-4ecb-b98c-681788bdfe4d tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] [instance: 4118df58-62f2-461f-a818-3e9d7fbf962e] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:20.240945 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-1c0a7ca2-1929-4ecb-b98c-681788bdfe4d tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:20.241699 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-1c0a7ca2-1929-4ecb-b98c-681788bdfe4d tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:20.242760 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-1c0a7ca2-1929-4ecb-b98c-681788bdfe4d tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:20.243415 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-1c0a7ca2-1929-4ecb-b98c-681788bdfe4d tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:20.514165 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-1c0a7ca2-1929-4ecb-b98c-681788bdfe4d tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7edc2b1d056341aaa31751f77cd03a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628680bdad9c4d2ebcb019bb40053ccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:20.525818 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-1c0a7ca2-1929-4ecb-b98c-681788bdfe4d tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] 10.222.0.64 "GET /compute/v2.1/servers/4118df58-62f2-461f-a818-3e9d7fbf962e" status: 200 len: 1313 microversion: 2.1 time: 0.308300 Jul 19 15:53:20.528055 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 519/985] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:20 2022] GET /compute/v2.1/servers/4118df58-62f2-461f-a818-3e9d7fbf962e => generated 1313 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:21.553302 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-a18d99d8-8afb-4d88-802c-b847d1d97f0d tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:21.561521 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-a18d99d8-8afb-4d88-802c-b847d1d97f0d tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] [instance: 4118df58-62f2-461f-a818-3e9d7fbf962e] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:21.585775 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-a18d99d8-8afb-4d88-802c-b847d1d97f0d tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:21.592556 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-a18d99d8-8afb-4d88-802c-b847d1d97f0d tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:21.594621 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-a18d99d8-8afb-4d88-802c-b847d1d97f0d tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:21.595268 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-a18d99d8-8afb-4d88-802c-b847d1d97f0d tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:22.189286 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-a18d99d8-8afb-4d88-802c-b847d1d97f0d tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7edc2b1d056341aaa31751f77cd03a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628680bdad9c4d2ebcb019bb40053ccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:22.197989 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-a18d99d8-8afb-4d88-802c-b847d1d97f0d tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] 10.222.0.64 "GET /compute/v2.1/servers/4118df58-62f2-461f-a818-3e9d7fbf962e" status: 200 len: 1313 microversion: 2.1 time: 0.656092 Jul 19 15:53:22.199249 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 467/986] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:21 2022] GET /compute/v2.1/servers/4118df58-62f2-461f-a818-3e9d7fbf962e => generated 1313 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:23.215355 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-362a0021-7409-4ef0-85aa-a0fbb6a68613 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:23.215965 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-362a0021-7409-4ef0-85aa-a0fbb6a68613 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] [instance: 4118df58-62f2-461f-a818-3e9d7fbf962e] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:23.223764 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-362a0021-7409-4ef0-85aa-a0fbb6a68613 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:23.224595 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-362a0021-7409-4ef0-85aa-a0fbb6a68613 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:23.225459 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-362a0021-7409-4ef0-85aa-a0fbb6a68613 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:23.225990 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-362a0021-7409-4ef0-85aa-a0fbb6a68613 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:23.422495 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-362a0021-7409-4ef0-85aa-a0fbb6a68613 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7edc2b1d056341aaa31751f77cd03a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628680bdad9c4d2ebcb019bb40053ccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:23.438618 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-362a0021-7409-4ef0-85aa-a0fbb6a68613 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] 10.222.0.64 "GET /compute/v2.1/servers/4118df58-62f2-461f-a818-3e9d7fbf962e" status: 200 len: 1313 microversion: 2.1 time: 0.226651 Jul 19 15:53:23.449120 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 520/987] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:23 2022] GET /compute/v2.1/servers/4118df58-62f2-461f-a818-3e9d7fbf962e => generated 1313 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:24.456169 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-0567c950-fcd2-4e67-a17c-d01168ef82b3 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:24.458047 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-0567c950-fcd2-4e67-a17c-d01168ef82b3 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] [instance: 4118df58-62f2-461f-a818-3e9d7fbf962e] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:24.467355 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-0567c950-fcd2-4e67-a17c-d01168ef82b3 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:24.468730 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-0567c950-fcd2-4e67-a17c-d01168ef82b3 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:24.469977 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-0567c950-fcd2-4e67-a17c-d01168ef82b3 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:24.470860 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-0567c950-fcd2-4e67-a17c-d01168ef82b3 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:24.697370 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-0567c950-fcd2-4e67-a17c-d01168ef82b3 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7edc2b1d056341aaa31751f77cd03a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628680bdad9c4d2ebcb019bb40053ccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:24.706014 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-0567c950-fcd2-4e67-a17c-d01168ef82b3 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] 10.222.0.64 "GET /compute/v2.1/servers/4118df58-62f2-461f-a818-3e9d7fbf962e" status: 200 len: 1313 microversion: 2.1 time: 0.254462 Jul 19 15:53:24.707312 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 468/988] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:24 2022] GET /compute/v2.1/servers/4118df58-62f2-461f-a818-3e9d7fbf962e => generated 1313 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:25.721204 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG dbcounter [-] [129520] Writing DB stats nova_cell0:SELECT=2 {{(pid=129520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:53:25.723617 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG dbcounter [-] [129520] Writing DB stats nova_cell0:SELECT=6 {{(pid=129520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:53:25.729146 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-2185f027-42f8-47ed-94c9-d38f7c4c7c54 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:25.729933 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-2185f027-42f8-47ed-94c9-d38f7c4c7c54 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] [instance: 4118df58-62f2-461f-a818-3e9d7fbf962e] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:25.737655 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-2185f027-42f8-47ed-94c9-d38f7c4c7c54 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:25.739065 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-2185f027-42f8-47ed-94c9-d38f7c4c7c54 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:25.740079 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-2185f027-42f8-47ed-94c9-d38f7c4c7c54 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:25.740725 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-2185f027-42f8-47ed-94c9-d38f7c4c7c54 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:26.060689 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-2185f027-42f8-47ed-94c9-d38f7c4c7c54 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7edc2b1d056341aaa31751f77cd03a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628680bdad9c4d2ebcb019bb40053ccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:26.071686 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-2185f027-42f8-47ed-94c9-d38f7c4c7c54 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] 10.222.0.64 "GET /compute/v2.1/servers/4118df58-62f2-461f-a818-3e9d7fbf962e" status: 200 len: 1313 microversion: 2.1 time: 0.350857 Jul 19 15:53:26.072629 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 521/989] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:25 2022] GET /compute/v2.1/servers/4118df58-62f2-461f-a818-3e9d7fbf962e => generated 1313 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:27.086889 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG dbcounter [-] [129519] Writing DB stats nova_cell0:SELECT=2 {{(pid=129519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:53:27.092206 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-a6db5280-7e01-4242-87dc-56cb308f18a8 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:27.092820 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-a6db5280-7e01-4242-87dc-56cb308f18a8 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] [instance: 4118df58-62f2-461f-a818-3e9d7fbf962e] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:27.107292 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-a6db5280-7e01-4242-87dc-56cb308f18a8 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:27.110372 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-a6db5280-7e01-4242-87dc-56cb308f18a8 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:27.111441 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-a6db5280-7e01-4242-87dc-56cb308f18a8 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:27.116465 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-a6db5280-7e01-4242-87dc-56cb308f18a8 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:27.449545 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [req-eb6e4848-6328-4e47-ac48-b8d8eb6be76a req-882cf7e8-5b13-4811-9cff-6e1a3d77f688 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4118df58-62f2-461f-a818-3e9d7fbf962e", "name": "network-vif-plugged", "status": "completed", "tag": "8661d5ec-05b5-4728-8464-6dfdedc3ac94"}]} {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:53:27.477215 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [req-eb6e4848-6328-4e47-ac48-b8d8eb6be76a req-882cf7e8-5b13-4811-9cff-6e1a3d77f688 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:27.483231 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [req-eb6e4848-6328-4e47-ac48-b8d8eb6be76a req-882cf7e8-5b13-4811-9cff-6e1a3d77f688 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:27.522037 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.compute.server_external_events [req-eb6e4848-6328-4e47-ac48-b8d8eb6be76a req-882cf7e8-5b13-4811-9cff-6e1a3d77f688 service nova] Creating event network-vif-plugged:8661d5ec-05b5-4728-8464-6dfdedc3ac94 for instance 4118df58-62f2-461f-a818-3e9d7fbf962e on hv-cinder-84902 Jul 19 15:53:27.535849 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [req-eb6e4848-6328-4e47-ac48-b8d8eb6be76a req-882cf7e8-5b13-4811-9cff-6e1a3d77f688 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088328 Jul 19 15:53:27.538554 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 522/990] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Jul 19 15:53:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 15:53:27.555748 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-a6db5280-7e01-4242-87dc-56cb308f18a8 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7edc2b1d056341aaa31751f77cd03a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628680bdad9c4d2ebcb019bb40053ccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:27.585352 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-a6db5280-7e01-4242-87dc-56cb308f18a8 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] 10.222.0.64 "GET /compute/v2.1/servers/4118df58-62f2-461f-a818-3e9d7fbf962e" status: 200 len: 1313 microversion: 2.1 time: 0.500067 Jul 19 15:53:27.586735 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 469/991] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:27 2022] GET /compute/v2.1/servers/4118df58-62f2-461f-a818-3e9d7fbf962e => generated 1313 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:28.606764 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-a4164450-713e-4960-bf97-34fb914b91b7 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:28.607476 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-a4164450-713e-4960-bf97-34fb914b91b7 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] [instance: 4118df58-62f2-461f-a818-3e9d7fbf962e] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:28.625973 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-a4164450-713e-4960-bf97-34fb914b91b7 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:28.628013 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-a4164450-713e-4960-bf97-34fb914b91b7 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:28.631554 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-a4164450-713e-4960-bf97-34fb914b91b7 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:28.632066 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-a4164450-713e-4960-bf97-34fb914b91b7 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:28.794910 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-ba4c28fb-1be2-4ab0-b862-bfb6fc2b9153 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2058187558", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-701832674", "security_groups": [{"name": "tempest-secgroup-smoke-1743401924"}], "block_device_mapping_v2": [{"uuid": "b0d53b9e-0848-4d1b-b0e6-d4bc96f1bdc4", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "195064b7-2168-479c-96ce-505c1a5c25ea"}]}} {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:53:28.921327 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-a4164450-713e-4960-bf97-34fb914b91b7 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7edc2b1d056341aaa31751f77cd03a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628680bdad9c4d2ebcb019bb40053ccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:28.930674 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-a4164450-713e-4960-bf97-34fb914b91b7 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] 10.222.0.64 "GET /compute/v2.1/servers/4118df58-62f2-461f-a818-3e9d7fbf962e" status: 200 len: 1313 microversion: 2.1 time: 0.329717 Jul 19 15:53:28.933651 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 523/992] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:28 2022] GET /compute/v2.1/servers/4118df58-62f2-461f-a818-3e9d7fbf962e => generated 1313 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:29.048120 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.network.neutron [None req-ba4c28fb-1be2-4ab0-b862-bfb6fc2b9153 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] validate_networks() for [('195064b7-2168-479c-96ce-505c1a5c25ea', None, None, None, None, None)] {{(pid=129519) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 15:53:29.446158 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-387e3154-8a11-4a56-9de0-febc677ec9eb tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Action: 'create', calling method: .version_select at 0x7fb8a5c76550>, body: {"keypair": {"name": "tempest-TestShelveInstance-11940315", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAieQZvnWn+d8CXeozwtSRCtXG63uyZM3L9jTF46KjFAGCsiiM0/QJq7MbpxG2K3q/zeRDxQtOH7x5g1VLrkcbk1/GPe2EnnaRlqBPBwFBM44C04cVZ8Li6yL8MLvhmFMA=="}} {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:53:29.475115 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.quota [None req-387e3154-8a11-4a56-9de0-febc677ec9eb tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Getting quotas for project cf521f7d98c641d4941eb041acf65405. Resources: {'key_pairs'} {{(pid=129520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 15:53:29.481998 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.quota [None req-387e3154-8a11-4a56-9de0-febc677ec9eb tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Getting quotas for user 674d054767ff4eec993ca7fefdce3967 and project cf521f7d98c641d4941eb041acf65405. Resources: {'key_pairs'} {{(pid=129520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 15:53:29.519018 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-387e3154-8a11-4a56-9de0-febc677ec9eb tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 395 microversion: 2.1 time: 0.405149 Jul 19 15:53:29.520605 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 524/993] 10.222.0.64 () {60 vars in 1158 bytes} [Tue Jul 19 15:53:29 2022] POST /compute/v2.1/os-keypairs => generated 395 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:53:29.622495 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.virt.hardware [None req-ba4c28fb-1be2-4ab0-b862-bfb6fc2b9153 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Flavor limits 0:0:0 {{(pid=129519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 15:53:29.623257 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.virt.hardware [None req-ba4c28fb-1be2-4ab0-b862-bfb6fc2b9153 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Image limits 0:0:0 {{(pid=129519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 15:53:29.623740 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.virt.hardware [None req-ba4c28fb-1be2-4ab0-b862-bfb6fc2b9153 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Flavor pref 0:0:0 {{(pid=129519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 15:53:29.624486 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.virt.hardware [None req-ba4c28fb-1be2-4ab0-b862-bfb6fc2b9153 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Image pref 0:0:0 {{(pid=129519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 15:53:29.625060 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.virt.hardware [None req-ba4c28fb-1be2-4ab0-b862-bfb6fc2b9153 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129519) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 15:53:29.635771 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-ba4c28fb-1be2-4ab0-b862-bfb6fc2b9153 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:29.636229 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-ba4c28fb-1be2-4ab0-b862-bfb6fc2b9153 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:29.637146 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-ba4c28fb-1be2-4ab0-b862-bfb6fc2b9153 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:29.637441 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-ba4c28fb-1be2-4ab0-b862-bfb6fc2b9153 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:29.659901 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.quota [None req-ba4c28fb-1be2-4ab0-b862-bfb6fc2b9153 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Getting quotas for project 6827afcdf1f3481882f808dc01908a4d. Resources: {'ram', 'instances', 'cores'} {{(pid=129519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 15:53:29.664692 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.quota [None req-ba4c28fb-1be2-4ab0-b862-bfb6fc2b9153 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Getting quotas for user ae334c4d93cd4d3e94789a5985fcfa77 and project 6827afcdf1f3481882f808dc01908a4d. Resources: {'ram', 'instances', 'cores'} {{(pid=129519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 15:53:29.754470 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-ba4c28fb-1be2-4ab0-b862-bfb6fc2b9153 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Going to run 1 instances... {{(pid=129519) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 15:53:29.759470 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-ba4c28fb-1be2-4ab0-b862-bfb6fc2b9153 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] [instance: 4a9ac02c-69eb-45b4-8380-42ab80044abe] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='b0d53b9e-0848-4d1b-b0e6-d4bc96f1bdc4',volume_size=None,volume_type=None)] {{(pid=129519) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 15:53:29.946715 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ba4c28fb-1be2-4ab0-b862-bfb6fc2b9153 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] [5b290b5f-13e1-46b5-9abf-aeb0a91ec740] AMQP server on 10.222.0.64:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 19 15:53:29.952207 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-c04d55ad-1944-4c21-9c16-d38270fd4474 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:29.952928 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-c04d55ad-1944-4c21-9c16-d38270fd4474 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] [instance: 4118df58-62f2-461f-a818-3e9d7fbf962e] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:29.961270 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-c04d55ad-1944-4c21-9c16-d38270fd4474 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:29.961875 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-c04d55ad-1944-4c21-9c16-d38270fd4474 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:29.962935 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-c04d55ad-1944-4c21-9c16-d38270fd4474 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:29.963450 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-c04d55ad-1944-4c21-9c16-d38270fd4474 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:30.184241 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-c04d55ad-1944-4c21-9c16-d38270fd4474 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7edc2b1d056341aaa31751f77cd03a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628680bdad9c4d2ebcb019bb40053ccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:30.198120 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-c04d55ad-1944-4c21-9c16-d38270fd4474 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] 10.222.0.64 "GET /compute/v2.1/servers/4118df58-62f2-461f-a818-3e9d7fbf962e" status: 200 len: 1496 microversion: 2.1 time: 0.249163 Jul 19 15:53:30.212420 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 525/994] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:29 2022] GET /compute/v2.1/servers/4118df58-62f2-461f-a818-3e9d7fbf962e => generated 1496 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:30.750216 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-7dc35a03-dcbb-4abd-ab35-f2824e7d4fa7 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:30.750955 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-7dc35a03-dcbb-4abd-ab35-f2824e7d4fa7 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] [instance: 4118df58-62f2-461f-a818-3e9d7fbf962e] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:30.759507 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-7dc35a03-dcbb-4abd-ab35-f2824e7d4fa7 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:30.760348 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-7dc35a03-dcbb-4abd-ab35-f2824e7d4fa7 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:30.761263 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-7dc35a03-dcbb-4abd-ab35-f2824e7d4fa7 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:30.761807 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-7dc35a03-dcbb-4abd-ab35-f2824e7d4fa7 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:30.805226 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-7dc35a03-dcbb-4abd-ab35-f2824e7d4fa7 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] [instance: 4118df58-62f2-461f-a818-3e9d7fbf962e] Going to try to terminate instance {{(pid=129520) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 15:53:30.929522 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-7dc35a03-dcbb-4abd-ab35-f2824e7d4fa7 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] 10.222.0.64 "DELETE /compute/v2.1/servers/4118df58-62f2-461f-a818-3e9d7fbf962e" status: 204 len: 0 microversion: 2.1 time: 0.183663 Jul 19 15:53:30.930216 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 526/995] 10.222.0.64 () {58 vars in 1238 bytes} [Tue Jul 19 15:53:30 2022] DELETE /compute/v2.1/servers/4118df58-62f2-461f-a818-3e9d7fbf962e => generated 0 bytes in 186 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 15:53:30.939450 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-b15a4d36-dd94-4bec-804f-c3b7cc4b65f1 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:30.940353 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-b15a4d36-dd94-4bec-804f-c3b7cc4b65f1 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] [instance: 4118df58-62f2-461f-a818-3e9d7fbf962e] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:30.947156 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b15a4d36-dd94-4bec-804f-c3b7cc4b65f1 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:30.947848 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b15a4d36-dd94-4bec-804f-c3b7cc4b65f1 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:30.948779 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b15a4d36-dd94-4bec-804f-c3b7cc4b65f1 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:30.949367 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b15a4d36-dd94-4bec-804f-c3b7cc4b65f1 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:30.954878 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO oslo.messaging._drivers.impl_rabbit [None req-ba4c28fb-1be2-4ab0-b862-bfb6fc2b9153 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] [5b290b5f-13e1-46b5-9abf-aeb0a91ec740] Reconnected to AMQP server on 10.222.0.64:5672 via [amqp] client with port 34736. Jul 19 15:53:30.966205 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-ba4c28fb-1be2-4ab0-b862-bfb6fc2b9153 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.175531 Jul 19 15:53:30.967490 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 470/996] 10.222.0.64 () {60 vars in 1146 bytes} [Tue Jul 19 15:53:28 2022] POST /compute/v2.1/servers => generated 406 bytes in 2177 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 15:53:30.978415 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-60316153-197f-4ded-85ce-3ac800efd606 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:30.980484 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-60316153-197f-4ded-85ce-3ac800efd606 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] [instance: 4a9ac02c-69eb-45b4-8380-42ab80044abe] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:31.081939 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-60316153-197f-4ded-85ce-3ac800efd606 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae334c4d93cd4d3e94789a5985fcfa77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6827afcdf1f3481882f808dc01908a4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:31.090656 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-60316153-197f-4ded-85ce-3ac800efd606 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] 10.222.0.64 "GET /compute/v2.1/servers/4a9ac02c-69eb-45b4-8380-42ab80044abe" status: 200 len: 1094 microversion: 2.1 time: 0.116892 Jul 19 15:53:31.092784 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 471/997] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:30 2022] GET /compute/v2.1/servers/4a9ac02c-69eb-45b4-8380-42ab80044abe => generated 1094 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:31.166389 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-b15a4d36-dd94-4bec-804f-c3b7cc4b65f1 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7edc2b1d056341aaa31751f77cd03a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628680bdad9c4d2ebcb019bb40053ccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:31.177046 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-b15a4d36-dd94-4bec-804f-c3b7cc4b65f1 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] 10.222.0.64 "GET /compute/v2.1/servers/4118df58-62f2-461f-a818-3e9d7fbf962e" status: 200 len: 1502 microversion: 2.1 time: 0.241738 Jul 19 15:53:31.188387 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 527/998] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:30 2022] GET /compute/v2.1/servers/4118df58-62f2-461f-a818-3e9d7fbf962e => generated 1502 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:32.111884 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-ce89c0af-bfbe-46bb-ac8a-a4aabb5d0e90 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:32.112508 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-ce89c0af-bfbe-46bb-ac8a-a4aabb5d0e90 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] [instance: 4a9ac02c-69eb-45b4-8380-42ab80044abe] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:32.143656 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-ce89c0af-bfbe-46bb-ac8a-a4aabb5d0e90 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:32.144123 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-ce89c0af-bfbe-46bb-ac8a-a4aabb5d0e90 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:32.144993 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-ce89c0af-bfbe-46bb-ac8a-a4aabb5d0e90 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:32.145632 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-ce89c0af-bfbe-46bb-ac8a-a4aabb5d0e90 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:32.194859 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-8eb47452-afb9-4f42-835d-12cbfa57f74e tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:32.195459 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-8eb47452-afb9-4f42-835d-12cbfa57f74e tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] [instance: 4118df58-62f2-461f-a818-3e9d7fbf962e] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:32.202047 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-8eb47452-afb9-4f42-835d-12cbfa57f74e tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:32.202786 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-8eb47452-afb9-4f42-835d-12cbfa57f74e tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:32.203783 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-8eb47452-afb9-4f42-835d-12cbfa57f74e tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:32.204987 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-8eb47452-afb9-4f42-835d-12cbfa57f74e tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:32.257022 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-ce89c0af-bfbe-46bb-ac8a-a4aabb5d0e90 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae334c4d93cd4d3e94789a5985fcfa77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6827afcdf1f3481882f808dc01908a4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:32.266016 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-ce89c0af-bfbe-46bb-ac8a-a4aabb5d0e90 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] 10.222.0.64 "GET /compute/v2.1/servers/4a9ac02c-69eb-45b4-8380-42ab80044abe" status: 200 len: 1136 microversion: 2.1 time: 0.160543 Jul 19 15:53:32.271778 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 472/999] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:32 2022] GET /compute/v2.1/servers/4a9ac02c-69eb-45b4-8380-42ab80044abe => generated 1136 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:32.536656 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-8eb47452-afb9-4f42-835d-12cbfa57f74e tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7edc2b1d056341aaa31751f77cd03a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628680bdad9c4d2ebcb019bb40053ccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:32.568729 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-8eb47452-afb9-4f42-835d-12cbfa57f74e tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] 10.222.0.64 "GET /compute/v2.1/servers/4118df58-62f2-461f-a818-3e9d7fbf962e" status: 200 len: 1502 microversion: 2.1 time: 0.377872 Jul 19 15:53:32.578533 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 528/1000] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:32 2022] GET /compute/v2.1/servers/4118df58-62f2-461f-a818-3e9d7fbf962e => generated 1502 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:53:33.058670 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [req-ce36d9c1-49bb-4d03-b4f6-0e9438d20ff7 req-5bae0d21-4446-4bd5-bba2-c9fb9d33325c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4118df58-62f2-461f-a818-3e9d7fbf962e", "name": "network-vif-deleted", "tag": "8661d5ec-05b5-4728-8464-6dfdedc3ac94"}]} {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:53:33.077463 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [req-ce36d9c1-49bb-4d03-b4f6-0e9438d20ff7 req-5bae0d21-4446-4bd5-bba2-c9fb9d33325c service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:33.078330 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [req-ce36d9c1-49bb-4d03-b4f6-0e9438d20ff7 req-5bae0d21-4446-4bd5-bba2-c9fb9d33325c service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:33.091972 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.compute.server_external_events [req-ce36d9c1-49bb-4d03-b4f6-0e9438d20ff7 req-5bae0d21-4446-4bd5-bba2-c9fb9d33325c service nova] Creating event network-vif-deleted:8661d5ec-05b5-4728-8464-6dfdedc3ac94 for instance 4118df58-62f2-461f-a818-3e9d7fbf962e on hv-cinder-84902 Jul 19 15:53:33.103147 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [req-ce36d9c1-49bb-4d03-b4f6-0e9438d20ff7 req-5bae0d21-4446-4bd5-bba2-c9fb9d33325c service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056617 Jul 19 15:53:33.104261 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 473/1001] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Jul 19 15:53:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:53:33.289392 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-b0f777ea-0141-4961-8274-6f6bd3d1a54b tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:33.290716 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-b0f777ea-0141-4961-8274-6f6bd3d1a54b tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] [instance: 4a9ac02c-69eb-45b4-8380-42ab80044abe] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:33.298099 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b0f777ea-0141-4961-8274-6f6bd3d1a54b tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:33.298590 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b0f777ea-0141-4961-8274-6f6bd3d1a54b tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:33.299974 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b0f777ea-0141-4961-8274-6f6bd3d1a54b tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:33.300434 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b0f777ea-0141-4961-8274-6f6bd3d1a54b tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:33.369107 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-b0f777ea-0141-4961-8274-6f6bd3d1a54b tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae334c4d93cd4d3e94789a5985fcfa77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6827afcdf1f3481882f808dc01908a4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:33.376709 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-b0f777ea-0141-4961-8274-6f6bd3d1a54b tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] 10.222.0.64 "GET /compute/v2.1/servers/4a9ac02c-69eb-45b4-8380-42ab80044abe" status: 200 len: 1210 microversion: 2.1 time: 0.092250 Jul 19 15:53:33.377578 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 529/1002] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:33 2022] GET /compute/v2.1/servers/4a9ac02c-69eb-45b4-8380-42ab80044abe => generated 1210 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:33.587391 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-b7fbbf5d-1c4b-4d0b-a1c5-e23c68234582 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:33.588350 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-b7fbbf5d-1c4b-4d0b-a1c5-e23c68234582 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] [instance: 4118df58-62f2-461f-a818-3e9d7fbf962e] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:33.603605 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-b7fbbf5d-1c4b-4d0b-a1c5-e23c68234582 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:33.604268 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-b7fbbf5d-1c4b-4d0b-a1c5-e23c68234582 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:33.605787 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-b7fbbf5d-1c4b-4d0b-a1c5-e23c68234582 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:33.610709 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-b7fbbf5d-1c4b-4d0b-a1c5-e23c68234582 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:33.671466 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-b7fbbf5d-1c4b-4d0b-a1c5-e23c68234582 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:33.672541 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-b7fbbf5d-1c4b-4d0b-a1c5-e23c68234582 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:33.673005 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.objects.instance [None req-b7fbbf5d-1c4b-4d0b-a1c5-e23c68234582 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lazy-loading 'fault' on Instance uuid 4118df58-62f2-461f-a818-3e9d7fbf962e {{(pid=129519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 15:53:33.725368 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-b7fbbf5d-1c4b-4d0b-a1c5-e23c68234582 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7edc2b1d056341aaa31751f77cd03a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628680bdad9c4d2ebcb019bb40053ccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:33.736604 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-b7fbbf5d-1c4b-4d0b-a1c5-e23c68234582 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] 10.222.0.64 "GET /compute/v2.1/servers/4118df58-62f2-461f-a818-3e9d7fbf962e" status: 200 len: 1303 microversion: 2.1 time: 0.154304 Jul 19 15:53:33.747400 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 474/1003] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:33 2022] GET /compute/v2.1/servers/4118df58-62f2-461f-a818-3e9d7fbf962e => generated 1303 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:34.398924 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-add28ab3-053e-4f38-827b-37dc3b0e8056 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:34.400119 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-add28ab3-053e-4f38-827b-37dc3b0e8056 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] [instance: 4a9ac02c-69eb-45b4-8380-42ab80044abe] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:34.413738 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-add28ab3-053e-4f38-827b-37dc3b0e8056 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:34.413738 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-add28ab3-053e-4f38-827b-37dc3b0e8056 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:34.414400 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-add28ab3-053e-4f38-827b-37dc3b0e8056 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:34.419324 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-add28ab3-053e-4f38-827b-37dc3b0e8056 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:34.645593 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-add28ab3-053e-4f38-827b-37dc3b0e8056 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae334c4d93cd4d3e94789a5985fcfa77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6827afcdf1f3481882f808dc01908a4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:34.653517 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-add28ab3-053e-4f38-827b-37dc3b0e8056 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] 10.222.0.64 "GET /compute/v2.1/servers/4a9ac02c-69eb-45b4-8380-42ab80044abe" status: 200 len: 1266 microversion: 2.1 time: 0.262618 Jul 19 15:53:34.654095 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 530/1004] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:34 2022] GET /compute/v2.1/servers/4a9ac02c-69eb-45b4-8380-42ab80044abe => generated 1266 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:34.761244 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-87ac414b-de9b-4f67-a2a6-71a205d9db67 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:34.763498 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-87ac414b-de9b-4f67-a2a6-71a205d9db67 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] [instance: 4118df58-62f2-461f-a818-3e9d7fbf962e] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:34.779003 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-87ac414b-de9b-4f67-a2a6-71a205d9db67 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:34.779614 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-87ac414b-de9b-4f67-a2a6-71a205d9db67 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:34.781043 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-87ac414b-de9b-4f67-a2a6-71a205d9db67 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:34.783214 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-87ac414b-de9b-4f67-a2a6-71a205d9db67 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:34.802504 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.wsgi [None req-87ac414b-de9b-4f67-a2a6-71a205d9db67 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] HTTP exception thrown: Instance 4118df58-62f2-461f-a818-3e9d7fbf962e could not be found. Jul 19 15:53:34.804572 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-87ac414b-de9b-4f67-a2a6-71a205d9db67 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Request method failure captured: Jul 19 15:53:34.804572 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: request: GET /compute/v2.1/servers/4118df58-62f2-461f-a818-3e9d7fbf962e HTTP/1.1 Jul 19 15:53:34.804572 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Accept: application/json Jul 19 15:53:34.804572 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Accept-Encoding: identity Jul 19 15:53:34.804572 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Connection: close Jul 19 15:53:34.804572 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Content-Length: 0 Jul 19 15:53:34.804572 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Content-Type: application/json Jul 19 15:53:34.804572 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Host: 10.222.0.64 Jul 19 15:53:34.804572 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Openstack-System-Scope: None Jul 19 15:53:34.804572 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: User-Agent: python-urllib3/1.26.9 Jul 19 15:53:34.804572 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Auth-Token: gAAAAABi1tNon5m-cSo5_MKF9rDW7nxsuhhpj7qf1gV2RBmhCLkltzUYYCPBW-KlhRpSMnTVwc3EH9vQCuGTL4-e-r8PH6v4EVEsZpNXN_85iHCfbt2kbdARmZK9Pej7LhqugC2rzHBYgJKSm-0QrtyFhxhHnMsZoqaavdi11wuXw8M2JGqNuHg Jul 19 15:53:34.804572 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Domain-Id: None Jul 19 15:53:34.804572 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Domain-Name: None Jul 19 15:53:34.804572 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Identity-Status: Confirmed Jul 19 15:53:34.804572 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Is-Admin-Project: True Jul 19 15:53:34.804572 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Domain-Id: default Jul 19 15:53:34.804572 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Domain-Name: Default Jul 19 15:53:34.804572 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Id: 628680bdad9c4d2ebcb019bb40053ccc Jul 19 15:53:34.804572 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Name: tempest-VolumesActionsTest-1222746508 Jul 19 15:53:34.804572 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Role: member,reader Jul 19 15:53:34.804572 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Roles: member,reader Jul 19 15:53:34.806050 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_628680bdad9c4d2ebcb019bb40053ccc", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/628680bdad9c4d2ebcb019bb40053ccc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/628680bdad9c4d2ebcb019bb40053ccc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/628680bdad9c4d2ebcb019bb40053ccc"}]}] Jul 19 15:53:34.806050 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Tenant: tempest-VolumesActionsTest-1222746508 Jul 19 15:53:34.806050 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Tenant-Id: 628680bdad9c4d2ebcb019bb40053ccc Jul 19 15:53:34.806050 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Tenant-Name: tempest-VolumesActionsTest-1222746508 Jul 19 15:53:34.806050 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User: tempest-VolumesActionsTest-1222746508-project Jul 19 15:53:34.806050 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Domain-Id: default Jul 19 15:53:34.806050 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Domain-Name: Default Jul 19 15:53:34.806050 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Id: 7edc2b1d056341aaa31751f77cd03a2c Jul 19 15:53:34.806050 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Name: tempest-VolumesActionsTest-1222746508-project Jul 19 15:53:34.806050 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: method: > Jul 19 15:53:34.806050 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: exception: Instance 4118df58-62f2-461f-a818-3e9d7fbf962e could not be found. Jul 19 15:53:34.806050 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: action_args: {'id': '4118df58-62f2-461f-a818-3e9d7fbf962e'} Jul 19 15:53:34.807313 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:53:34.807313 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:53:34.807313 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 15:53:34.807313 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 15:53:34.807313 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 15:53:34.807313 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 15:53:34.807313 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 15:53:34.807313 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 15:53:34.807313 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 15:53:34.807313 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 15:53:34.807313 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4118df58-62f2-461f-a818-3e9d7fbf962e could not be found. Jul 19 15:53:34.807313 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:53:34.807313 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:53:34.807313 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:53:34.807313 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:53:34.807313 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:53:34.807313 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:53:34.807313 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:53:34.807313 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:53:34.807313 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:53:34.809076 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:53:34.809076 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 15:53:34.809076 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 15:53:34.809076 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 15:53:34.809076 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 15:53:34.809076 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 15:53:34.809076 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 15:53:34.809076 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4118df58-62f2-461f-a818-3e9d7fbf962e could not be found. Jul 19 15:53:34.809076 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:53:34.809076 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:53:34.809076 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:53:34.809076 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:53:34.809076 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:53:34.809076 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:53:34.809076 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:53:34.809076 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:53:34.809076 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4118df58-62f2-461f-a818-3e9d7fbf962e could not be found. Jul 19 15:53:34.809076 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:53:34.812433 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-87ac414b-de9b-4f67-a2a6-71a205d9db67 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Returning 404 to user: Instance 4118df58-62f2-461f-a818-3e9d7fbf962e could not be found. {{(pid=129519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:53:34.813637 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-87ac414b-de9b-4f67-a2a6-71a205d9db67 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] 10.222.0.64 "GET /compute/v2.1/servers/4118df58-62f2-461f-a818-3e9d7fbf962e" status: 404 len: 111 microversion: 2.1 time: 0.061989 Jul 19 15:53:34.826866 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 475/1005] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:34 2022] GET /compute/v2.1/servers/4118df58-62f2-461f-a818-3e9d7fbf962e => generated 111 bytes in 76 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 15:53:35.004894 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-127ec684-1736-43e0-bf43-204f75059585 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2121348672", "imageRef": "15012099-fe38-45ac-bd33-d884a5ba65f2", "flavorRef": "452", "networks": [{"uuid": "7a7ccfd1-db0e-4890-9655-b5260413649d"}]}} {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:53:35.091399 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.network.neutron [None req-127ec684-1736-43e0-bf43-204f75059585 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] validate_networks() for [('7a7ccfd1-db0e-4890-9655-b5260413649d', None, None, None, None, None)] {{(pid=129520) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 15:53:35.614227 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [req-d585599b-44df-45b7-944e-da88df403efa req-9a932c76-9dd4-4a44-8fc8-9f586a7d4190 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a9ac02c-69eb-45b4-8380-42ab80044abe", "tag": "1c5f2b65-7e32-469b-be88-24a29ea25fa7"}]} {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:53:35.644269 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [req-d585599b-44df-45b7-944e-da88df403efa req-9a932c76-9dd4-4a44-8fc8-9f586a7d4190 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:35.649977 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [req-d585599b-44df-45b7-944e-da88df403efa req-9a932c76-9dd4-4a44-8fc8-9f586a7d4190 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:35.660878 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.compute.server_external_events [req-d585599b-44df-45b7-944e-da88df403efa req-9a932c76-9dd4-4a44-8fc8-9f586a7d4190 service nova] Creating event network-changed:1c5f2b65-7e32-469b-be88-24a29ea25fa7 for instance 4a9ac02c-69eb-45b4-8380-42ab80044abe on hv-cinder-84902 Jul 19 15:53:35.666720 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [req-d585599b-44df-45b7-944e-da88df403efa req-9a932c76-9dd4-4a44-8fc8-9f586a7d4190 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.057373 Jul 19 15:53:35.671172 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 476/1006] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Jul 19 15:53:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:53:35.681333 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-1f740d97-eafd-4b55-8ac9-413f8076a51c tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:35.683061 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-1f740d97-eafd-4b55-8ac9-413f8076a51c tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] [instance: 4a9ac02c-69eb-45b4-8380-42ab80044abe] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:35.690514 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-1f740d97-eafd-4b55-8ac9-413f8076a51c tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:35.691289 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-1f740d97-eafd-4b55-8ac9-413f8076a51c tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:35.692252 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-1f740d97-eafd-4b55-8ac9-413f8076a51c tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:35.692757 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-1f740d97-eafd-4b55-8ac9-413f8076a51c tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:35.848313 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.virt.hardware [None req-127ec684-1736-43e0-bf43-204f75059585 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Flavor limits 0:0:0 {{(pid=129520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 15:53:35.850864 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.virt.hardware [None req-127ec684-1736-43e0-bf43-204f75059585 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Image limits 0:0:0 {{(pid=129520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 15:53:35.851468 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.virt.hardware [None req-127ec684-1736-43e0-bf43-204f75059585 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Flavor pref 0:0:0 {{(pid=129520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 15:53:35.853409 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.virt.hardware [None req-127ec684-1736-43e0-bf43-204f75059585 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Image pref 0:0:0 {{(pid=129520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 15:53:35.853940 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.virt.hardware [None req-127ec684-1736-43e0-bf43-204f75059585 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 15:53:35.881967 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-127ec684-1736-43e0-bf43-204f75059585 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:35.882444 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-127ec684-1736-43e0-bf43-204f75059585 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:35.886082 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-127ec684-1736-43e0-bf43-204f75059585 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:35.886650 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-127ec684-1736-43e0-bf43-204f75059585 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:35.920894 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.quota [None req-127ec684-1736-43e0-bf43-204f75059585 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Getting quotas for project 628680bdad9c4d2ebcb019bb40053ccc. Resources: {'ram', 'instances', 'cores'} {{(pid=129520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 15:53:35.926274 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.quota [None req-127ec684-1736-43e0-bf43-204f75059585 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Getting quotas for user 7edc2b1d056341aaa31751f77cd03a2c and project 628680bdad9c4d2ebcb019bb40053ccc. Resources: {'ram', 'instances', 'cores'} {{(pid=129520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 15:53:35.939628 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-127ec684-1736-43e0-bf43-204f75059585 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Going to run 1 instances... {{(pid=129520) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 15:53:35.943229 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-127ec684-1736-43e0-bf43-204f75059585 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] [instance: 725285fd-4ed0-49f9-9bf6-d4c728027ab9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='15012099-fe38-45ac-bd33-d884a5ba65f2',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 15:53:35.994621 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-1f740d97-eafd-4b55-8ac9-413f8076a51c tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae334c4d93cd4d3e94789a5985fcfa77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6827afcdf1f3481882f808dc01908a4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:36.012866 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-127ec684-1736-43e0-bf43-204f75059585 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.012305 Jul 19 15:53:36.018672 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 531/1007] 10.222.0.64 () {60 vars in 1146 bytes} [Tue Jul 19 15:53:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 1014 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 15:53:36.020619 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-1f740d97-eafd-4b55-8ac9-413f8076a51c tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] 10.222.0.64 "GET /compute/v2.1/servers/4a9ac02c-69eb-45b4-8380-42ab80044abe" status: 200 len: 1266 microversion: 2.1 time: 0.347500 Jul 19 15:53:36.029818 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 477/1008] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:35 2022] GET /compute/v2.1/servers/4a9ac02c-69eb-45b4-8380-42ab80044abe => generated 1266 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:36.030320 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-f1439a45-9d3c-4801-9cda-e35d219ea27f tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:36.030320 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-f1439a45-9d3c-4801-9cda-e35d219ea27f tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] [instance: 725285fd-4ed0-49f9-9bf6-d4c728027ab9] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:36.156689 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-f1439a45-9d3c-4801-9cda-e35d219ea27f tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7edc2b1d056341aaa31751f77cd03a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628680bdad9c4d2ebcb019bb40053ccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:36.171710 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-f1439a45-9d3c-4801-9cda-e35d219ea27f tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] 10.222.0.64 "GET /compute/v2.1/servers/725285fd-4ed0-49f9-9bf6-d4c728027ab9" status: 200 len: 1214 microversion: 2.1 time: 0.151302 Jul 19 15:53:36.172322 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 532/1009] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:36 2022] GET /compute/v2.1/servers/725285fd-4ed0-49f9-9bf6-d4c728027ab9 => generated 1214 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:37.037501 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-41e67adb-a629-4257-80a4-c270fc2fa5d6 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:37.038260 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-41e67adb-a629-4257-80a4-c270fc2fa5d6 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] [instance: 4a9ac02c-69eb-45b4-8380-42ab80044abe] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:37.048847 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-41e67adb-a629-4257-80a4-c270fc2fa5d6 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:37.049303 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-41e67adb-a629-4257-80a4-c270fc2fa5d6 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:37.050235 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-41e67adb-a629-4257-80a4-c270fc2fa5d6 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:37.051229 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-41e67adb-a629-4257-80a4-c270fc2fa5d6 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:37.190641 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-c7dccb56-545c-42ee-ac1c-ee03d7c1223b tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:37.192040 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-c7dccb56-545c-42ee-ac1c-ee03d7c1223b tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] [instance: 725285fd-4ed0-49f9-9bf6-d4c728027ab9] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:37.217555 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-c7dccb56-545c-42ee-ac1c-ee03d7c1223b tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:37.218329 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-c7dccb56-545c-42ee-ac1c-ee03d7c1223b tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:37.219177 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-c7dccb56-545c-42ee-ac1c-ee03d7c1223b tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:37.219658 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-c7dccb56-545c-42ee-ac1c-ee03d7c1223b tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:37.282432 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-41e67adb-a629-4257-80a4-c270fc2fa5d6 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae334c4d93cd4d3e94789a5985fcfa77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6827afcdf1f3481882f808dc01908a4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:37.297798 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-41e67adb-a629-4257-80a4-c270fc2fa5d6 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] 10.222.0.64 "GET /compute/v2.1/servers/4a9ac02c-69eb-45b4-8380-42ab80044abe" status: 200 len: 1266 microversion: 2.1 time: 0.264294 Jul 19 15:53:37.308628 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 478/1010] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:37 2022] GET /compute/v2.1/servers/4a9ac02c-69eb-45b4-8380-42ab80044abe => generated 1266 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:37.375436 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-c7dccb56-545c-42ee-ac1c-ee03d7c1223b tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7edc2b1d056341aaa31751f77cd03a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628680bdad9c4d2ebcb019bb40053ccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:37.384170 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-c7dccb56-545c-42ee-ac1c-ee03d7c1223b tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] 10.222.0.64 "GET /compute/v2.1/servers/725285fd-4ed0-49f9-9bf6-d4c728027ab9" status: 200 len: 1274 microversion: 2.1 time: 0.198575 Jul 19 15:53:37.395044 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 533/1011] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:37 2022] GET /compute/v2.1/servers/725285fd-4ed0-49f9-9bf6-d4c728027ab9 => generated 1274 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:53:38.320358 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-73776d58-679a-4a27-b93c-08b9a4c6dafe tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:38.320904 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-73776d58-679a-4a27-b93c-08b9a4c6dafe tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] [instance: 4a9ac02c-69eb-45b4-8380-42ab80044abe] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:38.326985 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-73776d58-679a-4a27-b93c-08b9a4c6dafe tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:38.327442 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-73776d58-679a-4a27-b93c-08b9a4c6dafe tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:38.328211 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-73776d58-679a-4a27-b93c-08b9a4c6dafe tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:38.328647 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-73776d58-679a-4a27-b93c-08b9a4c6dafe tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:38.403019 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-fa8efbc3-49cf-4418-a7f3-4ba0341fa55d tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:38.404552 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-fa8efbc3-49cf-4418-a7f3-4ba0341fa55d tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] [instance: 725285fd-4ed0-49f9-9bf6-d4c728027ab9] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:38.413960 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-fa8efbc3-49cf-4418-a7f3-4ba0341fa55d tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:38.414926 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-fa8efbc3-49cf-4418-a7f3-4ba0341fa55d tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:38.415755 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-fa8efbc3-49cf-4418-a7f3-4ba0341fa55d tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:38.416510 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-fa8efbc3-49cf-4418-a7f3-4ba0341fa55d tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:38.560893 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-73776d58-679a-4a27-b93c-08b9a4c6dafe tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae334c4d93cd4d3e94789a5985fcfa77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6827afcdf1f3481882f808dc01908a4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:38.571715 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-73776d58-679a-4a27-b93c-08b9a4c6dafe tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] 10.222.0.64 "GET /compute/v2.1/servers/4a9ac02c-69eb-45b4-8380-42ab80044abe" status: 200 len: 1266 microversion: 2.1 time: 0.260218 Jul 19 15:53:38.583089 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 479/1012] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:38 2022] GET /compute/v2.1/servers/4a9ac02c-69eb-45b4-8380-42ab80044abe => generated 1266 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:53:38.597804 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-fa8efbc3-49cf-4418-a7f3-4ba0341fa55d tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7edc2b1d056341aaa31751f77cd03a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628680bdad9c4d2ebcb019bb40053ccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:38.602167 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG dbcounter [-] [129520] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:53:38.621873 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-fa8efbc3-49cf-4418-a7f3-4ba0341fa55d tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] 10.222.0.64 "GET /compute/v2.1/servers/725285fd-4ed0-49f9-9bf6-d4c728027ab9" status: 200 len: 1314 microversion: 2.1 time: 0.223940 Jul 19 15:53:38.622785 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 534/1013] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:38 2022] GET /compute/v2.1/servers/725285fd-4ed0-49f9-9bf6-d4c728027ab9 => generated 1314 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:38.852842 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [req-63872285-b21d-4629-9016-6ffa3b61232d req-f638ba16-5aad-4cab-8c47-7e12d844b209 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "725285fd-4ed0-49f9-9bf6-d4c728027ab9", "tag": "e0e269dc-9e47-4001-b795-361c854acd42"}]} {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:53:38.865214 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [req-63872285-b21d-4629-9016-6ffa3b61232d req-f638ba16-5aad-4cab-8c47-7e12d844b209 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:38.866179 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [req-63872285-b21d-4629-9016-6ffa3b61232d req-f638ba16-5aad-4cab-8c47-7e12d844b209 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:38.881675 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.compute.server_external_events [req-63872285-b21d-4629-9016-6ffa3b61232d req-f638ba16-5aad-4cab-8c47-7e12d844b209 service nova] Creating event network-changed:e0e269dc-9e47-4001-b795-361c854acd42 for instance 725285fd-4ed0-49f9-9bf6-d4c728027ab9 on hv-cinder-84902 Jul 19 15:53:38.890089 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [req-63872285-b21d-4629-9016-6ffa3b61232d req-f638ba16-5aad-4cab-8c47-7e12d844b209 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041142 Jul 19 15:53:38.890716 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 480/1014] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Jul 19 15:53:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:53:39.591006 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-585cc1c2-225f-4bcd-87c7-88e2d3e1c998 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:39.591757 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-585cc1c2-225f-4bcd-87c7-88e2d3e1c998 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] [instance: 4a9ac02c-69eb-45b4-8380-42ab80044abe] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:39.600355 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-585cc1c2-225f-4bcd-87c7-88e2d3e1c998 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:39.600812 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-585cc1c2-225f-4bcd-87c7-88e2d3e1c998 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:39.601634 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-585cc1c2-225f-4bcd-87c7-88e2d3e1c998 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:39.602250 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-585cc1c2-225f-4bcd-87c7-88e2d3e1c998 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:39.641450 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-ee92e304-58b5-4e38-abd9-144caaf1b285 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:39.642270 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-ee92e304-58b5-4e38-abd9-144caaf1b285 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] [instance: 725285fd-4ed0-49f9-9bf6-d4c728027ab9] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:39.647848 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG dbcounter [-] [129519] Writing DB stats nova_cell0:SELECT=2 {{(pid=129519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:53:39.649974 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-ee92e304-58b5-4e38-abd9-144caaf1b285 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:39.650540 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-ee92e304-58b5-4e38-abd9-144caaf1b285 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:39.651362 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-ee92e304-58b5-4e38-abd9-144caaf1b285 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:39.651859 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-ee92e304-58b5-4e38-abd9-144caaf1b285 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:39.749230 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-585cc1c2-225f-4bcd-87c7-88e2d3e1c998 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae334c4d93cd4d3e94789a5985fcfa77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6827afcdf1f3481882f808dc01908a4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:39.757077 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-585cc1c2-225f-4bcd-87c7-88e2d3e1c998 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] 10.222.0.64 "GET /compute/v2.1/servers/4a9ac02c-69eb-45b4-8380-42ab80044abe" status: 200 len: 1266 microversion: 2.1 time: 0.171525 Jul 19 15:53:39.757658 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 535/1015] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:39 2022] GET /compute/v2.1/servers/4a9ac02c-69eb-45b4-8380-42ab80044abe => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:39.791558 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-ee92e304-58b5-4e38-abd9-144caaf1b285 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7edc2b1d056341aaa31751f77cd03a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628680bdad9c4d2ebcb019bb40053ccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:39.799438 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-ee92e304-58b5-4e38-abd9-144caaf1b285 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] 10.222.0.64 "GET /compute/v2.1/servers/725285fd-4ed0-49f9-9bf6-d4c728027ab9" status: 200 len: 1314 microversion: 2.1 time: 0.162108 Jul 19 15:53:39.800028 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 481/1016] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:39 2022] GET /compute/v2.1/servers/725285fd-4ed0-49f9-9bf6-d4c728027ab9 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:53:40.774457 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-fe26a071-38e1-40e5-b7c1-b9fda7de2a74 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:40.775181 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-fe26a071-38e1-40e5-b7c1-b9fda7de2a74 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] [instance: 4a9ac02c-69eb-45b4-8380-42ab80044abe] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:40.783259 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-fe26a071-38e1-40e5-b7c1-b9fda7de2a74 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:40.783814 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-fe26a071-38e1-40e5-b7c1-b9fda7de2a74 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:40.784916 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-fe26a071-38e1-40e5-b7c1-b9fda7de2a74 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:40.785652 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-fe26a071-38e1-40e5-b7c1-b9fda7de2a74 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:40.819166 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-6d993e92-c210-4794-a293-fe32674dd7aa tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:40.820440 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-6d993e92-c210-4794-a293-fe32674dd7aa tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] [instance: 725285fd-4ed0-49f9-9bf6-d4c728027ab9] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:40.827698 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-6d993e92-c210-4794-a293-fe32674dd7aa tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:40.828641 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-6d993e92-c210-4794-a293-fe32674dd7aa tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:40.829885 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-6d993e92-c210-4794-a293-fe32674dd7aa tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:40.830472 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-6d993e92-c210-4794-a293-fe32674dd7aa tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:40.934824 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-fe26a071-38e1-40e5-b7c1-b9fda7de2a74 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae334c4d93cd4d3e94789a5985fcfa77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6827afcdf1f3481882f808dc01908a4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:40.940931 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-fe26a071-38e1-40e5-b7c1-b9fda7de2a74 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] 10.222.0.64 "GET /compute/v2.1/servers/4a9ac02c-69eb-45b4-8380-42ab80044abe" status: 200 len: 1266 microversion: 2.1 time: 0.171291 Jul 19 15:53:40.941518 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 536/1017] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:40 2022] GET /compute/v2.1/servers/4a9ac02c-69eb-45b4-8380-42ab80044abe => generated 1266 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:41.049453 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-6d993e92-c210-4794-a293-fe32674dd7aa tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7edc2b1d056341aaa31751f77cd03a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628680bdad9c4d2ebcb019bb40053ccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:41.057807 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-6d993e92-c210-4794-a293-fe32674dd7aa tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] 10.222.0.64 "GET /compute/v2.1/servers/725285fd-4ed0-49f9-9bf6-d4c728027ab9" status: 200 len: 1314 microversion: 2.1 time: 0.244001 Jul 19 15:53:41.058395 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 482/1018] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:40 2022] GET /compute/v2.1/servers/725285fd-4ed0-49f9-9bf6-d4c728027ab9 => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:53:41.956886 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-51a4ccd5-61d6-4dfd-bf1b-907f35090163 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:41.958236 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-51a4ccd5-61d6-4dfd-bf1b-907f35090163 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] [instance: 4a9ac02c-69eb-45b4-8380-42ab80044abe] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:41.964819 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-51a4ccd5-61d6-4dfd-bf1b-907f35090163 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:41.965270 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-51a4ccd5-61d6-4dfd-bf1b-907f35090163 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:41.966036 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-51a4ccd5-61d6-4dfd-bf1b-907f35090163 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:41.966509 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-51a4ccd5-61d6-4dfd-bf1b-907f35090163 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:42.072316 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG dbcounter [-] [129519] Writing DB stats nova_cell0:SELECT=8 {{(pid=129519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:53:42.077384 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-5c2f21be-1038-4a49-aa90-82cb9bc79c26 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:42.078115 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-5c2f21be-1038-4a49-aa90-82cb9bc79c26 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] [instance: 725285fd-4ed0-49f9-9bf6-d4c728027ab9] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:42.084909 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-5c2f21be-1038-4a49-aa90-82cb9bc79c26 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:42.085644 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-5c2f21be-1038-4a49-aa90-82cb9bc79c26 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:42.086649 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-5c2f21be-1038-4a49-aa90-82cb9bc79c26 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:42.087096 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-5c2f21be-1038-4a49-aa90-82cb9bc79c26 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:42.116208 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-51a4ccd5-61d6-4dfd-bf1b-907f35090163 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae334c4d93cd4d3e94789a5985fcfa77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6827afcdf1f3481882f808dc01908a4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:42.133467 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-51a4ccd5-61d6-4dfd-bf1b-907f35090163 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] 10.222.0.64 "GET /compute/v2.1/servers/4a9ac02c-69eb-45b4-8380-42ab80044abe" status: 200 len: 1266 microversion: 2.1 time: 0.180349 Jul 19 15:53:42.134167 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 537/1019] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:41 2022] GET /compute/v2.1/servers/4a9ac02c-69eb-45b4-8380-42ab80044abe => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:42.256787 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-5c2f21be-1038-4a49-aa90-82cb9bc79c26 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7edc2b1d056341aaa31751f77cd03a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628680bdad9c4d2ebcb019bb40053ccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:42.264249 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-5c2f21be-1038-4a49-aa90-82cb9bc79c26 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] 10.222.0.64 "GET /compute/v2.1/servers/725285fd-4ed0-49f9-9bf6-d4c728027ab9" status: 200 len: 1314 microversion: 2.1 time: 0.192749 Jul 19 15:53:42.264813 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 483/1020] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:42 2022] GET /compute/v2.1/servers/725285fd-4ed0-49f9-9bf6-d4c728027ab9 => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:53:43.151000 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-c3de4772-26d7-443d-a4ef-a927a21a0b9a tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:43.151656 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-c3de4772-26d7-443d-a4ef-a927a21a0b9a tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] [instance: 4a9ac02c-69eb-45b4-8380-42ab80044abe] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:43.158311 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-c3de4772-26d7-443d-a4ef-a927a21a0b9a tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:43.158811 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-c3de4772-26d7-443d-a4ef-a927a21a0b9a tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:43.159593 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-c3de4772-26d7-443d-a4ef-a927a21a0b9a tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:43.160037 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-c3de4772-26d7-443d-a4ef-a927a21a0b9a tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:43.282347 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-aeffbcc7-60dd-430d-9ea0-fd5761c57ed1 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:43.283119 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-aeffbcc7-60dd-430d-9ea0-fd5761c57ed1 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] [instance: 725285fd-4ed0-49f9-9bf6-d4c728027ab9] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:43.291135 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-aeffbcc7-60dd-430d-9ea0-fd5761c57ed1 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:43.292064 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-aeffbcc7-60dd-430d-9ea0-fd5761c57ed1 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:43.293213 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-aeffbcc7-60dd-430d-9ea0-fd5761c57ed1 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:43.293723 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-aeffbcc7-60dd-430d-9ea0-fd5761c57ed1 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:43.312520 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-c3de4772-26d7-443d-a4ef-a927a21a0b9a tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae334c4d93cd4d3e94789a5985fcfa77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6827afcdf1f3481882f808dc01908a4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:43.321412 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-c3de4772-26d7-443d-a4ef-a927a21a0b9a tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] 10.222.0.64 "GET /compute/v2.1/servers/4a9ac02c-69eb-45b4-8380-42ab80044abe" status: 200 len: 1266 microversion: 2.1 time: 0.174294 Jul 19 15:53:43.321979 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 538/1021] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:43 2022] GET /compute/v2.1/servers/4a9ac02c-69eb-45b4-8380-42ab80044abe => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:43.434728 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-aeffbcc7-60dd-430d-9ea0-fd5761c57ed1 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7edc2b1d056341aaa31751f77cd03a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628680bdad9c4d2ebcb019bb40053ccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:43.440371 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-aeffbcc7-60dd-430d-9ea0-fd5761c57ed1 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] 10.222.0.64 "GET /compute/v2.1/servers/725285fd-4ed0-49f9-9bf6-d4c728027ab9" status: 200 len: 1314 microversion: 2.1 time: 0.162305 Jul 19 15:53:43.441022 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 484/1022] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:43 2022] GET /compute/v2.1/servers/725285fd-4ed0-49f9-9bf6-d4c728027ab9 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:53:44.339408 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-95a93a32-d48a-406b-94bc-8a8b98abdf0f tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:44.340335 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-95a93a32-d48a-406b-94bc-8a8b98abdf0f tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] [instance: 4a9ac02c-69eb-45b4-8380-42ab80044abe] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:44.347254 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-95a93a32-d48a-406b-94bc-8a8b98abdf0f tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:44.347915 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-95a93a32-d48a-406b-94bc-8a8b98abdf0f tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:44.348840 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-95a93a32-d48a-406b-94bc-8a8b98abdf0f tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:44.349280 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-95a93a32-d48a-406b-94bc-8a8b98abdf0f tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:44.457068 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-ea5e37cb-3e39-45b2-a4b0-526cd5ae0d9a tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:44.458613 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-ea5e37cb-3e39-45b2-a4b0-526cd5ae0d9a tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] [instance: 725285fd-4ed0-49f9-9bf6-d4c728027ab9] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:44.465679 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-ea5e37cb-3e39-45b2-a4b0-526cd5ae0d9a tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:44.466129 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-ea5e37cb-3e39-45b2-a4b0-526cd5ae0d9a tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:44.466983 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-ea5e37cb-3e39-45b2-a4b0-526cd5ae0d9a tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:44.467419 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-ea5e37cb-3e39-45b2-a4b0-526cd5ae0d9a tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:44.492998 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-95a93a32-d48a-406b-94bc-8a8b98abdf0f tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae334c4d93cd4d3e94789a5985fcfa77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6827afcdf1f3481882f808dc01908a4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:44.500526 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-95a93a32-d48a-406b-94bc-8a8b98abdf0f tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] 10.222.0.64 "GET /compute/v2.1/servers/4a9ac02c-69eb-45b4-8380-42ab80044abe" status: 200 len: 1266 microversion: 2.1 time: 0.164945 Jul 19 15:53:44.501097 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 539/1023] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:44 2022] GET /compute/v2.1/servers/4a9ac02c-69eb-45b4-8380-42ab80044abe => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:44.610460 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-ea5e37cb-3e39-45b2-a4b0-526cd5ae0d9a tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7edc2b1d056341aaa31751f77cd03a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628680bdad9c4d2ebcb019bb40053ccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:44.619535 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-ea5e37cb-3e39-45b2-a4b0-526cd5ae0d9a tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] 10.222.0.64 "GET /compute/v2.1/servers/725285fd-4ed0-49f9-9bf6-d4c728027ab9" status: 200 len: 1314 microversion: 2.1 time: 0.166314 Jul 19 15:53:44.620502 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 485/1024] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:44 2022] GET /compute/v2.1/servers/725285fd-4ed0-49f9-9bf6-d4c728027ab9 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:53:45.044879 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [req-d91cc139-aca6-437c-a76c-73fffafb9ff3 req-262d7bb2-097e-4d98-854c-6b7b34e401bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "725285fd-4ed0-49f9-9bf6-d4c728027ab9", "name": "network-vif-plugged", "status": "completed", "tag": "e0e269dc-9e47-4001-b795-361c854acd42"}]} {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:53:45.049250 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG dbcounter [-] [129520] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=129520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:53:45.053613 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [req-d91cc139-aca6-437c-a76c-73fffafb9ff3 req-262d7bb2-097e-4d98-854c-6b7b34e401bf service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:45.054314 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [req-d91cc139-aca6-437c-a76c-73fffafb9ff3 req-262d7bb2-097e-4d98-854c-6b7b34e401bf service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:45.067863 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.compute.server_external_events [req-d91cc139-aca6-437c-a76c-73fffafb9ff3 req-262d7bb2-097e-4d98-854c-6b7b34e401bf service nova] Creating event network-vif-plugged:e0e269dc-9e47-4001-b795-361c854acd42 for instance 725285fd-4ed0-49f9-9bf6-d4c728027ab9 on hv-cinder-84902 Jul 19 15:53:45.073568 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [req-d91cc139-aca6-437c-a76c-73fffafb9ff3 req-262d7bb2-097e-4d98-854c-6b7b34e401bf service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032826 Jul 19 15:53:45.074156 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 540/1025] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Jul 19 15:53:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:53:45.526596 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-be31feb8-e4bc-4f1c-a0dc-a55abca02097 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:45.526596 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-be31feb8-e4bc-4f1c-a0dc-a55abca02097 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] [instance: 4a9ac02c-69eb-45b4-8380-42ab80044abe] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:45.526596 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG dbcounter [-] [129519] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=3 {{(pid=129519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:53:45.527255 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-be31feb8-e4bc-4f1c-a0dc-a55abca02097 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:45.527365 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-be31feb8-e4bc-4f1c-a0dc-a55abca02097 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:45.528870 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-be31feb8-e4bc-4f1c-a0dc-a55abca02097 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:45.529499 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-be31feb8-e4bc-4f1c-a0dc-a55abca02097 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:45.534672 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG dbcounter [-] [129519] Writing DB stats nova_cell1:SELECT=99 {{(pid=129519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:53:45.641817 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-8e124cdc-9353-4c39-b412-a86fc9d04ad2 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:45.641817 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-8e124cdc-9353-4c39-b412-a86fc9d04ad2 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] [instance: 725285fd-4ed0-49f9-9bf6-d4c728027ab9] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:45.656867 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-8e124cdc-9353-4c39-b412-a86fc9d04ad2 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:45.657455 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-8e124cdc-9353-4c39-b412-a86fc9d04ad2 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:45.658290 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-8e124cdc-9353-4c39-b412-a86fc9d04ad2 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:45.658795 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-8e124cdc-9353-4c39-b412-a86fc9d04ad2 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:45.740841 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-be31feb8-e4bc-4f1c-a0dc-a55abca02097 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae334c4d93cd4d3e94789a5985fcfa77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6827afcdf1f3481882f808dc01908a4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:45.750278 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-be31feb8-e4bc-4f1c-a0dc-a55abca02097 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] 10.222.0.64 "GET /compute/v2.1/servers/4a9ac02c-69eb-45b4-8380-42ab80044abe" status: 200 len: 1266 microversion: 2.1 time: 0.235898 Jul 19 15:53:45.750902 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 486/1026] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:45 2022] GET /compute/v2.1/servers/4a9ac02c-69eb-45b4-8380-42ab80044abe => generated 1266 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:45.833376 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-8e124cdc-9353-4c39-b412-a86fc9d04ad2 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7edc2b1d056341aaa31751f77cd03a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628680bdad9c4d2ebcb019bb40053ccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:45.841244 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-8e124cdc-9353-4c39-b412-a86fc9d04ad2 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] 10.222.0.64 "GET /compute/v2.1/servers/725285fd-4ed0-49f9-9bf6-d4c728027ab9" status: 200 len: 1314 microversion: 2.1 time: 0.207778 Jul 19 15:53:45.841799 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 541/1027] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:45 2022] GET /compute/v2.1/servers/725285fd-4ed0-49f9-9bf6-d4c728027ab9 => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:53:46.767933 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-e9c77847-b517-4021-94c9-f58f534890fe tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:46.769189 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-e9c77847-b517-4021-94c9-f58f534890fe tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] [instance: 4a9ac02c-69eb-45b4-8380-42ab80044abe] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:46.771019 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG dbcounter [-] [129520] Writing DB stats nova_cell0:SELECT=2 {{(pid=129520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:53:46.771814 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG dbcounter [-] [129520] Writing DB stats nova_cell0:SELECT=12 {{(pid=129520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:53:46.776360 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-e9c77847-b517-4021-94c9-f58f534890fe tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:46.776791 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-4d0501a8-5e61-4816-b337-19ecbd77d52f tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-585882448", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-11940315", "security_groups": [{"name": "tempest-secgroup-smoke-523264057"}], "networks": [{"uuid": "6889f24c-6e7e-40a5-a521-2143b6f00622"}], "block_device_mapping_v2": [{"uuid": "151760ea-c5c7-45f0-a987-5d58230cf8e8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:53:46.776944 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-e9c77847-b517-4021-94c9-f58f534890fe tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:46.777572 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-e9c77847-b517-4021-94c9-f58f534890fe tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:46.778017 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-e9c77847-b517-4021-94c9-f58f534890fe tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:46.923095 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.network.neutron [None req-4d0501a8-5e61-4816-b337-19ecbd77d52f tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] validate_networks() for [('6889f24c-6e7e-40a5-a521-2143b6f00622', None, None, None, None, None)] {{(pid=129520) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 15:53:46.971387 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-e9c77847-b517-4021-94c9-f58f534890fe tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae334c4d93cd4d3e94789a5985fcfa77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6827afcdf1f3481882f808dc01908a4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:46.979644 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-e9c77847-b517-4021-94c9-f58f534890fe tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] 10.222.0.64 "GET /compute/v2.1/servers/4a9ac02c-69eb-45b4-8380-42ab80044abe" status: 200 len: 1266 microversion: 2.1 time: 0.215443 Jul 19 15:53:46.980341 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 487/1028] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:46 2022] GET /compute/v2.1/servers/4a9ac02c-69eb-45b4-8380-42ab80044abe => generated 1266 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:46.998284 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-5019f60b-d80d-4132-9644-f2952dc9074d tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:47.000480 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-5019f60b-d80d-4132-9644-f2952dc9074d tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] [instance: 725285fd-4ed0-49f9-9bf6-d4c728027ab9] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:47.011891 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-5019f60b-d80d-4132-9644-f2952dc9074d tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:47.020854 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-5019f60b-d80d-4132-9644-f2952dc9074d tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:47.020854 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-5019f60b-d80d-4132-9644-f2952dc9074d tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:47.020854 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-5019f60b-d80d-4132-9644-f2952dc9074d tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:47.155292 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-5019f60b-d80d-4132-9644-f2952dc9074d tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7edc2b1d056341aaa31751f77cd03a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628680bdad9c4d2ebcb019bb40053ccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:47.165959 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-5019f60b-d80d-4132-9644-f2952dc9074d tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] 10.222.0.64 "GET /compute/v2.1/servers/725285fd-4ed0-49f9-9bf6-d4c728027ab9" status: 200 len: 1497 microversion: 2.1 time: 0.173131 Jul 19 15:53:47.166864 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 488/1029] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:46 2022] GET /compute/v2.1/servers/725285fd-4ed0-49f9-9bf6-d4c728027ab9 => generated 1497 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:47.172941 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [req-f640f5f7-e122-463b-b25d-eac9b1d9b422 req-9e80c8c2-58b4-499f-8430-8ebfe83aeb19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a9ac02c-69eb-45b4-8380-42ab80044abe", "name": "network-vif-plugged", "status": "completed", "tag": "1c5f2b65-7e32-469b-be88-24a29ea25fa7"}]} {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:53:47.187828 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [req-f640f5f7-e122-463b-b25d-eac9b1d9b422 req-9e80c8c2-58b4-499f-8430-8ebfe83aeb19 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:47.188276 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [req-f640f5f7-e122-463b-b25d-eac9b1d9b422 req-9e80c8c2-58b4-499f-8430-8ebfe83aeb19 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:47.202419 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.compute.server_external_events [req-f640f5f7-e122-463b-b25d-eac9b1d9b422 req-9e80c8c2-58b4-499f-8430-8ebfe83aeb19 service nova] Creating event network-vif-plugged:1c5f2b65-7e32-469b-be88-24a29ea25fa7 for instance 4a9ac02c-69eb-45b4-8380-42ab80044abe on hv-cinder-84902 Jul 19 15:53:47.208673 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [req-f640f5f7-e122-463b-b25d-eac9b1d9b422 req-9e80c8c2-58b4-499f-8430-8ebfe83aeb19 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039732 Jul 19 15:53:47.209811 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 489/1030] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Jul 19 15:53:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:53:47.350305 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.virt.hardware [None req-4d0501a8-5e61-4816-b337-19ecbd77d52f tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Flavor limits 0:0:0 {{(pid=129520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 15:53:47.350755 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.virt.hardware [None req-4d0501a8-5e61-4816-b337-19ecbd77d52f tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Image limits 0:0:0 {{(pid=129520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 15:53:47.351230 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.virt.hardware [None req-4d0501a8-5e61-4816-b337-19ecbd77d52f tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Flavor pref 0:0:0 {{(pid=129520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 15:53:47.352108 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.virt.hardware [None req-4d0501a8-5e61-4816-b337-19ecbd77d52f tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Image pref 0:0:0 {{(pid=129520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 15:53:47.352108 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.virt.hardware [None req-4d0501a8-5e61-4816-b337-19ecbd77d52f tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 15:53:47.361651 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-4d0501a8-5e61-4816-b337-19ecbd77d52f tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:47.362105 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-4d0501a8-5e61-4816-b337-19ecbd77d52f tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:47.363902 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-4d0501a8-5e61-4816-b337-19ecbd77d52f tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:47.365003 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-4d0501a8-5e61-4816-b337-19ecbd77d52f tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:47.383843 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.quota [None req-4d0501a8-5e61-4816-b337-19ecbd77d52f tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Getting quotas for project cf521f7d98c641d4941eb041acf65405. Resources: {'ram', 'instances', 'cores'} {{(pid=129520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 15:53:47.388263 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.quota [None req-4d0501a8-5e61-4816-b337-19ecbd77d52f tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Getting quotas for user 674d054767ff4eec993ca7fefdce3967 and project cf521f7d98c641d4941eb041acf65405. Resources: {'ram', 'instances', 'cores'} {{(pid=129520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 15:53:47.454665 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-4d0501a8-5e61-4816-b337-19ecbd77d52f tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Going to run 1 instances... {{(pid=129520) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 15:53:47.457522 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-4d0501a8-5e61-4816-b337-19ecbd77d52f tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] [instance: 40d79e6b-f23e-47aa-bb6c-04c1a6605256] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='151760ea-c5c7-45f0-a987-5d58230cf8e8',volume_size=None,volume_type=None)] {{(pid=129520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 15:53:47.601269 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-4d0501a8-5e61-4816-b337-19ecbd77d52f tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.831591 Jul 19 15:53:47.601925 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 542/1031] 10.222.0.64 () {60 vars in 1146 bytes} [Tue Jul 19 15:53:46 2022] POST /compute/v2.1/servers => generated 405 bytes in 833 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 15:53:47.613520 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-f2331d86-310d-48da-81ba-33221501e200 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:47.614663 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-f2331d86-310d-48da-81ba-33221501e200 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] [instance: 40d79e6b-f23e-47aa-bb6c-04c1a6605256] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:47.682528 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-f2331d86-310d-48da-81ba-33221501e200 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674d054767ff4eec993ca7fefdce3967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf521f7d98c641d4941eb041acf65405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:47.690215 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-f2331d86-310d-48da-81ba-33221501e200 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] 10.222.0.64 "GET /compute/v2.1/servers/40d79e6b-f23e-47aa-bb6c-04c1a6605256" status: 200 len: 1086 microversion: 2.1 time: 0.081470 Jul 19 15:53:47.690763 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 490/1032] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:47 2022] GET /compute/v2.1/servers/40d79e6b-f23e-47aa-bb6c-04c1a6605256 => generated 1086 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:47.802976 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-ed59d507-08d5-4d8b-a620-7e53cda514d1 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:47.803526 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-ed59d507-08d5-4d8b-a620-7e53cda514d1 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] [instance: 725285fd-4ed0-49f9-9bf6-d4c728027ab9] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:47.810192 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-ed59d507-08d5-4d8b-a620-7e53cda514d1 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:47.810691 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-ed59d507-08d5-4d8b-a620-7e53cda514d1 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:47.811466 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-ed59d507-08d5-4d8b-a620-7e53cda514d1 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:47.811913 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-ed59d507-08d5-4d8b-a620-7e53cda514d1 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:47.838440 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-ed59d507-08d5-4d8b-a620-7e53cda514d1 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] [instance: 725285fd-4ed0-49f9-9bf6-d4c728027ab9] Going to try to terminate instance {{(pid=129520) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 15:53:47.917113 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-ed59d507-08d5-4d8b-a620-7e53cda514d1 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] 10.222.0.64 "DELETE /compute/v2.1/servers/725285fd-4ed0-49f9-9bf6-d4c728027ab9" status: 204 len: 0 microversion: 2.1 time: 0.118124 Jul 19 15:53:47.917748 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 543/1033] 10.222.0.64 () {58 vars in 1238 bytes} [Tue Jul 19 15:53:47 2022] DELETE /compute/v2.1/servers/725285fd-4ed0-49f9-9bf6-d4c728027ab9 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 15:53:47.926627 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-def18675-0d72-4c3e-8376-e7f553f2781e tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:47.927344 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-def18675-0d72-4c3e-8376-e7f553f2781e tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] [instance: 725285fd-4ed0-49f9-9bf6-d4c728027ab9] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:47.934713 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-def18675-0d72-4c3e-8376-e7f553f2781e tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:47.935157 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-def18675-0d72-4c3e-8376-e7f553f2781e tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:47.935909 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-def18675-0d72-4c3e-8376-e7f553f2781e tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:47.936338 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-def18675-0d72-4c3e-8376-e7f553f2781e tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:47.997840 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-51efcb79-6ec7-4d84-a9ba-76cf969114b1 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:47.998568 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-51efcb79-6ec7-4d84-a9ba-76cf969114b1 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] [instance: 4a9ac02c-69eb-45b4-8380-42ab80044abe] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:48.005435 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-51efcb79-6ec7-4d84-a9ba-76cf969114b1 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:48.005889 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-51efcb79-6ec7-4d84-a9ba-76cf969114b1 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:48.006694 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-51efcb79-6ec7-4d84-a9ba-76cf969114b1 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:48.007132 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-51efcb79-6ec7-4d84-a9ba-76cf969114b1 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:48.078203 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-def18675-0d72-4c3e-8376-e7f553f2781e tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7edc2b1d056341aaa31751f77cd03a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628680bdad9c4d2ebcb019bb40053ccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:48.087696 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-def18675-0d72-4c3e-8376-e7f553f2781e tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] 10.222.0.64 "GET /compute/v2.1/servers/725285fd-4ed0-49f9-9bf6-d4c728027ab9" status: 200 len: 1503 microversion: 2.1 time: 0.165586 Jul 19 15:53:48.088500 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 491/1034] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:47 2022] GET /compute/v2.1/servers/725285fd-4ed0-49f9-9bf6-d4c728027ab9 => generated 1503 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:48.171622 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-51efcb79-6ec7-4d84-a9ba-76cf969114b1 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae334c4d93cd4d3e94789a5985fcfa77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6827afcdf1f3481882f808dc01908a4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:48.179967 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-51efcb79-6ec7-4d84-a9ba-76cf969114b1 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] 10.222.0.64 "GET /compute/v2.1/servers/4a9ac02c-69eb-45b4-8380-42ab80044abe" status: 200 len: 1266 microversion: 2.1 time: 0.186428 Jul 19 15:53:48.180533 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 544/1035] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:47 2022] GET /compute/v2.1/servers/4a9ac02c-69eb-45b4-8380-42ab80044abe => generated 1266 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:48.707227 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-1bc53b8b-c628-4185-838d-5817b4011fd9 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:48.707842 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-1bc53b8b-c628-4185-838d-5817b4011fd9 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] [instance: 40d79e6b-f23e-47aa-bb6c-04c1a6605256] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:48.713893 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-1bc53b8b-c628-4185-838d-5817b4011fd9 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:48.714350 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-1bc53b8b-c628-4185-838d-5817b4011fd9 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:48.715142 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-1bc53b8b-c628-4185-838d-5817b4011fd9 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:48.715579 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-1bc53b8b-c628-4185-838d-5817b4011fd9 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:48.780175 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-1bc53b8b-c628-4185-838d-5817b4011fd9 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674d054767ff4eec993ca7fefdce3967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf521f7d98c641d4941eb041acf65405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:48.788487 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-1bc53b8b-c628-4185-838d-5817b4011fd9 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] 10.222.0.64 "GET /compute/v2.1/servers/40d79e6b-f23e-47aa-bb6c-04c1a6605256" status: 200 len: 1136 microversion: 2.1 time: 0.085281 Jul 19 15:53:48.789050 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 492/1036] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:48 2022] GET /compute/v2.1/servers/40d79e6b-f23e-47aa-bb6c-04c1a6605256 => generated 1136 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:49.105089 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-89189f0b-3538-41ea-b606-8788018c8131 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:49.105699 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-89189f0b-3538-41ea-b606-8788018c8131 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] [instance: 725285fd-4ed0-49f9-9bf6-d4c728027ab9] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:49.112364 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-89189f0b-3538-41ea-b606-8788018c8131 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:49.112820 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-89189f0b-3538-41ea-b606-8788018c8131 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:49.113905 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-89189f0b-3538-41ea-b606-8788018c8131 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:49.114350 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-89189f0b-3538-41ea-b606-8788018c8131 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:49.199747 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-5e6e5e48-d75b-483d-94b5-cfd01a96f5fd tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:49.200367 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-5e6e5e48-d75b-483d-94b5-cfd01a96f5fd tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] [instance: 4a9ac02c-69eb-45b4-8380-42ab80044abe] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:49.207664 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-5e6e5e48-d75b-483d-94b5-cfd01a96f5fd tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:49.208128 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-5e6e5e48-d75b-483d-94b5-cfd01a96f5fd tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:49.208905 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-5e6e5e48-d75b-483d-94b5-cfd01a96f5fd tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:49.209343 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-5e6e5e48-d75b-483d-94b5-cfd01a96f5fd tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:49.253220 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-89189f0b-3538-41ea-b606-8788018c8131 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7edc2b1d056341aaa31751f77cd03a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628680bdad9c4d2ebcb019bb40053ccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:49.261267 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-89189f0b-3538-41ea-b606-8788018c8131 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] 10.222.0.64 "GET /compute/v2.1/servers/725285fd-4ed0-49f9-9bf6-d4c728027ab9" status: 200 len: 1503 microversion: 2.1 time: 0.159967 Jul 19 15:53:49.262833 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 545/1037] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:49 2022] GET /compute/v2.1/servers/725285fd-4ed0-49f9-9bf6-d4c728027ab9 => generated 1503 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:49.377352 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-5e6e5e48-d75b-483d-94b5-cfd01a96f5fd tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae334c4d93cd4d3e94789a5985fcfa77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6827afcdf1f3481882f808dc01908a4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:49.386339 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-5e6e5e48-d75b-483d-94b5-cfd01a96f5fd tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] 10.222.0.64 "GET /compute/v2.1/servers/4a9ac02c-69eb-45b4-8380-42ab80044abe" status: 200 len: 1266 microversion: 2.1 time: 0.193433 Jul 19 15:53:49.386935 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 493/1038] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:49 2022] GET /compute/v2.1/servers/4a9ac02c-69eb-45b4-8380-42ab80044abe => generated 1266 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:53:49.805741 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-3f4b07d3-7224-4181-9e24-a10a3198346d tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:49.806595 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-3f4b07d3-7224-4181-9e24-a10a3198346d tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] [instance: 40d79e6b-f23e-47aa-bb6c-04c1a6605256] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:49.814190 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-3f4b07d3-7224-4181-9e24-a10a3198346d tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:49.814852 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-3f4b07d3-7224-4181-9e24-a10a3198346d tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:49.815887 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-3f4b07d3-7224-4181-9e24-a10a3198346d tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:49.816460 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-3f4b07d3-7224-4181-9e24-a10a3198346d tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:49.887091 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-3f4b07d3-7224-4181-9e24-a10a3198346d tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674d054767ff4eec993ca7fefdce3967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf521f7d98c641d4941eb041acf65405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:49.898258 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-3f4b07d3-7224-4181-9e24-a10a3198346d tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] 10.222.0.64 "GET /compute/v2.1/servers/40d79e6b-f23e-47aa-bb6c-04c1a6605256" status: 200 len: 1184 microversion: 2.1 time: 0.096575 Jul 19 15:53:49.898871 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 546/1039] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:49 2022] GET /compute/v2.1/servers/40d79e6b-f23e-47aa-bb6c-04c1a6605256 => generated 1184 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:50.281311 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-2ab4945f-b3bf-4bd0-a1a7-9324fe2e6750 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:50.282669 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-2ab4945f-b3bf-4bd0-a1a7-9324fe2e6750 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] [instance: 725285fd-4ed0-49f9-9bf6-d4c728027ab9] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:50.291905 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-2ab4945f-b3bf-4bd0-a1a7-9324fe2e6750 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:50.292702 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-2ab4945f-b3bf-4bd0-a1a7-9324fe2e6750 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:50.293776 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-2ab4945f-b3bf-4bd0-a1a7-9324fe2e6750 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:50.294209 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-2ab4945f-b3bf-4bd0-a1a7-9324fe2e6750 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:50.405847 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-8f31086f-5708-4f82-ba43-81555fc8f90d tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:50.407239 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-8f31086f-5708-4f82-ba43-81555fc8f90d tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] [instance: 4a9ac02c-69eb-45b4-8380-42ab80044abe] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:50.415992 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-8f31086f-5708-4f82-ba43-81555fc8f90d tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:50.416642 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-8f31086f-5708-4f82-ba43-81555fc8f90d tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:50.417872 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-8f31086f-5708-4f82-ba43-81555fc8f90d tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:50.418500 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-8f31086f-5708-4f82-ba43-81555fc8f90d tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:50.524298 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-2ab4945f-b3bf-4bd0-a1a7-9324fe2e6750 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7edc2b1d056341aaa31751f77cd03a2c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '628680bdad9c4d2ebcb019bb40053ccc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:50.541003 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-2ab4945f-b3bf-4bd0-a1a7-9324fe2e6750 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] 10.222.0.64 "GET /compute/v2.1/servers/725285fd-4ed0-49f9-9bf6-d4c728027ab9" status: 200 len: 1503 microversion: 2.1 time: 0.264010 Jul 19 15:53:50.542951 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 494/1040] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:50 2022] GET /compute/v2.1/servers/725285fd-4ed0-49f9-9bf6-d4c728027ab9 => generated 1503 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:50.612082 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [req-8e94c861-b4ec-4a8b-bd1e-f6c7c3514063 req-f809ccbc-e563-4539-9898-b5971ae4fca6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "725285fd-4ed0-49f9-9bf6-d4c728027ab9", "name": "network-vif-deleted", "tag": "e0e269dc-9e47-4001-b795-361c854acd42"}]} {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:53:50.623032 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [req-8e94c861-b4ec-4a8b-bd1e-f6c7c3514063 req-f809ccbc-e563-4539-9898-b5971ae4fca6 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:50.623564 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [req-8e94c861-b4ec-4a8b-bd1e-f6c7c3514063 req-f809ccbc-e563-4539-9898-b5971ae4fca6 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:50.641428 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.compute.server_external_events [req-8e94c861-b4ec-4a8b-bd1e-f6c7c3514063 req-f809ccbc-e563-4539-9898-b5971ae4fca6 service nova] Creating event network-vif-deleted:e0e269dc-9e47-4001-b795-361c854acd42 for instance 725285fd-4ed0-49f9-9bf6-d4c728027ab9 on hv-cinder-84902 Jul 19 15:53:50.647198 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [req-8e94c861-b4ec-4a8b-bd1e-f6c7c3514063 req-f809ccbc-e563-4539-9898-b5971ae4fca6 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039079 Jul 19 15:53:50.648399 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 495/1041] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Jul 19 15:53:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 15:53:50.690635 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-8f31086f-5708-4f82-ba43-81555fc8f90d tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae334c4d93cd4d3e94789a5985fcfa77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6827afcdf1f3481882f808dc01908a4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:50.701334 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-8f31086f-5708-4f82-ba43-81555fc8f90d tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] 10.222.0.64 "GET /compute/v2.1/servers/4a9ac02c-69eb-45b4-8380-42ab80044abe" status: 200 len: 1453 microversion: 2.1 time: 0.299656 Jul 19 15:53:50.713621 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 547/1042] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:50 2022] GET /compute/v2.1/servers/4a9ac02c-69eb-45b4-8380-42ab80044abe => generated 1453 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:50.720150 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-98f5833e-d377-4420-a4e9-56991c93e11e tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:50.721371 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-98f5833e-d377-4420-a4e9-56991c93e11e tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] [instance: 4a9ac02c-69eb-45b4-8380-42ab80044abe] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:50.730204 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-98f5833e-d377-4420-a4e9-56991c93e11e tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:50.730685 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-98f5833e-d377-4420-a4e9-56991c93e11e tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:50.731477 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-98f5833e-d377-4420-a4e9-56991c93e11e tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:50.731918 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-98f5833e-d377-4420-a4e9-56991c93e11e tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:50.875395 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-98f5833e-d377-4420-a4e9-56991c93e11e tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae334c4d93cd4d3e94789a5985fcfa77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6827afcdf1f3481882f808dc01908a4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:50.884078 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-98f5833e-d377-4420-a4e9-56991c93e11e tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] 10.222.0.64 "GET /compute/v2.1/servers/4a9ac02c-69eb-45b4-8380-42ab80044abe" status: 200 len: 1453 microversion: 2.1 time: 0.168830 Jul 19 15:53:50.884579 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 496/1043] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:50 2022] GET /compute/v2.1/servers/4a9ac02c-69eb-45b4-8380-42ab80044abe => generated 1453 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:50.915009 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-72f00429-1866-4031-94f7-81cc58aee7f8 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:50.915628 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-72f00429-1866-4031-94f7-81cc58aee7f8 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] [instance: 40d79e6b-f23e-47aa-bb6c-04c1a6605256] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:50.922217 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-72f00429-1866-4031-94f7-81cc58aee7f8 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:50.922889 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-72f00429-1866-4031-94f7-81cc58aee7f8 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:50.923661 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-72f00429-1866-4031-94f7-81cc58aee7f8 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:50.924090 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-72f00429-1866-4031-94f7-81cc58aee7f8 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:51.264007 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-72f00429-1866-4031-94f7-81cc58aee7f8 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674d054767ff4eec993ca7fefdce3967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf521f7d98c641d4941eb041acf65405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:51.272327 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-72f00429-1866-4031-94f7-81cc58aee7f8 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] 10.222.0.64 "GET /compute/v2.1/servers/40d79e6b-f23e-47aa-bb6c-04c1a6605256" status: 200 len: 1269 microversion: 2.1 time: 0.361320 Jul 19 15:53:51.273273 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 548/1044] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:50 2022] GET /compute/v2.1/servers/40d79e6b-f23e-47aa-bb6c-04c1a6605256 => generated 1269 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:51.561607 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-6fe88676-12cb-4b05-a1be-5188797beee7 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:51.562990 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-6fe88676-12cb-4b05-a1be-5188797beee7 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] [instance: 725285fd-4ed0-49f9-9bf6-d4c728027ab9] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:51.571024 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-6fe88676-12cb-4b05-a1be-5188797beee7 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:51.571592 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-6fe88676-12cb-4b05-a1be-5188797beee7 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:51.572652 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-6fe88676-12cb-4b05-a1be-5188797beee7 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:51.573257 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-6fe88676-12cb-4b05-a1be-5188797beee7 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:51.590931 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.wsgi [None req-6fe88676-12cb-4b05-a1be-5188797beee7 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] HTTP exception thrown: Instance 725285fd-4ed0-49f9-9bf6-d4c728027ab9 could not be found. Jul 19 15:53:51.592884 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-6fe88676-12cb-4b05-a1be-5188797beee7 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Request method failure captured: Jul 19 15:53:51.592884 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: request: GET /compute/v2.1/servers/725285fd-4ed0-49f9-9bf6-d4c728027ab9 HTTP/1.1 Jul 19 15:53:51.592884 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Accept: application/json Jul 19 15:53:51.592884 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Accept-Encoding: identity Jul 19 15:53:51.592884 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Connection: close Jul 19 15:53:51.592884 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Content-Length: 0 Jul 19 15:53:51.592884 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Content-Type: application/json Jul 19 15:53:51.592884 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Host: 10.222.0.64 Jul 19 15:53:51.592884 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Openstack-System-Scope: None Jul 19 15:53:51.592884 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: User-Agent: python-urllib3/1.26.9 Jul 19 15:53:51.592884 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Auth-Token: gAAAAABi1tNon5m-cSo5_MKF9rDW7nxsuhhpj7qf1gV2RBmhCLkltzUYYCPBW-KlhRpSMnTVwc3EH9vQCuGTL4-e-r8PH6v4EVEsZpNXN_85iHCfbt2kbdARmZK9Pej7LhqugC2rzHBYgJKSm-0QrtyFhxhHnMsZoqaavdi11wuXw8M2JGqNuHg Jul 19 15:53:51.592884 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Domain-Id: None Jul 19 15:53:51.592884 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Domain-Name: None Jul 19 15:53:51.592884 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Identity-Status: Confirmed Jul 19 15:53:51.592884 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Is-Admin-Project: True Jul 19 15:53:51.592884 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Domain-Id: default Jul 19 15:53:51.592884 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Domain-Name: Default Jul 19 15:53:51.592884 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Id: 628680bdad9c4d2ebcb019bb40053ccc Jul 19 15:53:51.592884 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Name: tempest-VolumesActionsTest-1222746508 Jul 19 15:53:51.592884 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Role: member,reader Jul 19 15:53:51.592884 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Roles: member,reader Jul 19 15:53:51.594533 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_628680bdad9c4d2ebcb019bb40053ccc", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/628680bdad9c4d2ebcb019bb40053ccc"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/628680bdad9c4d2ebcb019bb40053ccc"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/628680bdad9c4d2ebcb019bb40053ccc"}]}] Jul 19 15:53:51.594533 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Tenant: tempest-VolumesActionsTest-1222746508 Jul 19 15:53:51.594533 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Tenant-Id: 628680bdad9c4d2ebcb019bb40053ccc Jul 19 15:53:51.594533 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Tenant-Name: tempest-VolumesActionsTest-1222746508 Jul 19 15:53:51.594533 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User: tempest-VolumesActionsTest-1222746508-project Jul 19 15:53:51.594533 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Domain-Id: default Jul 19 15:53:51.594533 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Domain-Name: Default Jul 19 15:53:51.594533 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Id: 7edc2b1d056341aaa31751f77cd03a2c Jul 19 15:53:51.594533 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Name: tempest-VolumesActionsTest-1222746508-project Jul 19 15:53:51.594533 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: method: > Jul 19 15:53:51.594533 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: exception: Instance 725285fd-4ed0-49f9-9bf6-d4c728027ab9 could not be found. Jul 19 15:53:51.594533 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: action_args: {'id': '725285fd-4ed0-49f9-9bf6-d4c728027ab9'} Jul 19 15:53:51.595412 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:53:51.595412 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:53:51.595412 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 15:53:51.595412 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 15:53:51.595412 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 15:53:51.595412 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 15:53:51.595412 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 15:53:51.595412 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 15:53:51.595412 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 15:53:51.595412 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 15:53:51.595412 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 725285fd-4ed0-49f9-9bf6-d4c728027ab9 could not be found. Jul 19 15:53:51.595412 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:53:51.595412 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:53:51.595412 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:53:51.595412 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:53:51.595412 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:53:51.595412 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:53:51.595412 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:53:51.595412 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:53:51.595412 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:53:51.597037 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:53:51.597037 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 15:53:51.597037 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 15:53:51.597037 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 15:53:51.597037 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 15:53:51.597037 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 15:53:51.597037 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 15:53:51.597037 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 725285fd-4ed0-49f9-9bf6-d4c728027ab9 could not be found. Jul 19 15:53:51.597037 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:53:51.597037 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:53:51.597037 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:53:51.597037 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:53:51.597037 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:53:51.597037 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:53:51.597037 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:53:51.597037 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:53:51.597037 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 725285fd-4ed0-49f9-9bf6-d4c728027ab9 could not be found. Jul 19 15:53:51.597037 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:53:51.600326 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-6fe88676-12cb-4b05-a1be-5188797beee7 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] Returning 404 to user: Instance 725285fd-4ed0-49f9-9bf6-d4c728027ab9 could not be found. {{(pid=129519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:53:51.601390 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-6fe88676-12cb-4b05-a1be-5188797beee7 tempest-VolumesActionsTest-1222746508 tempest-VolumesActionsTest-1222746508-project] 10.222.0.64 "GET /compute/v2.1/servers/725285fd-4ed0-49f9-9bf6-d4c728027ab9" status: 404 len: 111 microversion: 2.1 time: 0.045805 Jul 19 15:53:51.602163 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 497/1045] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:51 2022] GET /compute/v2.1/servers/725285fd-4ed0-49f9-9bf6-d4c728027ab9 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 15:53:52.013768 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [req-1928f180-7cf0-4b33-b87c-d51ec94b8a8b req-1c28e2d0-4c20-403c-8a15-f3d2c23486e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40d79e6b-f23e-47aa-bb6c-04c1a6605256", "tag": "1afaa31f-2b36-4dde-a958-b15bf3c12a62"}]} {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:53:52.032625 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [req-1928f180-7cf0-4b33-b87c-d51ec94b8a8b req-1c28e2d0-4c20-403c-8a15-f3d2c23486e8 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:52.033733 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [req-1928f180-7cf0-4b33-b87c-d51ec94b8a8b req-1c28e2d0-4c20-403c-8a15-f3d2c23486e8 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:52.059041 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.compute.server_external_events [req-1928f180-7cf0-4b33-b87c-d51ec94b8a8b req-1c28e2d0-4c20-403c-8a15-f3d2c23486e8 service nova] Creating event network-changed:1afaa31f-2b36-4dde-a958-b15bf3c12a62 for instance 40d79e6b-f23e-47aa-bb6c-04c1a6605256 on hv-cinder-84902 Jul 19 15:53:52.073520 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [req-1928f180-7cf0-4b33-b87c-d51ec94b8a8b req-1c28e2d0-4c20-403c-8a15-f3d2c23486e8 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069209 Jul 19 15:53:52.075316 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 549/1046] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Jul 19 15:53:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:53:52.290861 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-06bcb779-9c79-4bb9-ab57-17c2a6a8988c tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:52.291684 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-06bcb779-9c79-4bb9-ab57-17c2a6a8988c tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] [instance: 40d79e6b-f23e-47aa-bb6c-04c1a6605256] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:52.298644 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-06bcb779-9c79-4bb9-ab57-17c2a6a8988c tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:52.299317 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-06bcb779-9c79-4bb9-ab57-17c2a6a8988c tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:52.300719 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-06bcb779-9c79-4bb9-ab57-17c2a6a8988c tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:52.301659 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-06bcb779-9c79-4bb9-ab57-17c2a6a8988c tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:52.586555 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-06bcb779-9c79-4bb9-ab57-17c2a6a8988c tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674d054767ff4eec993ca7fefdce3967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf521f7d98c641d4941eb041acf65405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:52.595614 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-06bcb779-9c79-4bb9-ab57-17c2a6a8988c tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] 10.222.0.64 "GET /compute/v2.1/servers/40d79e6b-f23e-47aa-bb6c-04c1a6605256" status: 200 len: 1257 microversion: 2.1 time: 0.309269 Jul 19 15:53:52.597753 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 498/1047] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:52 2022] GET /compute/v2.1/servers/40d79e6b-f23e-47aa-bb6c-04c1a6605256 => generated 1257 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:53:53.597252 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [req-463b3955-625a-46f8-baf7-420814c972e6 req-0b1168cc-393b-41b2-9433-e25eadf16a7e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a9ac02c-69eb-45b4-8380-42ab80044abe", "tag": "1c5f2b65-7e32-469b-be88-24a29ea25fa7"}]} {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:53:53.606010 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [req-463b3955-625a-46f8-baf7-420814c972e6 req-0b1168cc-393b-41b2-9433-e25eadf16a7e service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:53.606487 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [req-463b3955-625a-46f8-baf7-420814c972e6 req-0b1168cc-393b-41b2-9433-e25eadf16a7e service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:53.616985 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-748ec271-a0c2-4dd5-bbaf-2a8ee201cb6a tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:53.617896 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-748ec271-a0c2-4dd5-bbaf-2a8ee201cb6a tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] [instance: 40d79e6b-f23e-47aa-bb6c-04c1a6605256] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:53.619623 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.compute.server_external_events [req-463b3955-625a-46f8-baf7-420814c972e6 req-0b1168cc-393b-41b2-9433-e25eadf16a7e service nova] Creating event network-changed:1c5f2b65-7e32-469b-be88-24a29ea25fa7 for instance 4a9ac02c-69eb-45b4-8380-42ab80044abe on hv-cinder-84902 Jul 19 15:53:53.624697 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-748ec271-a0c2-4dd5-bbaf-2a8ee201cb6a tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:53.624869 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [req-463b3955-625a-46f8-baf7-420814c972e6 req-0b1168cc-393b-41b2-9433-e25eadf16a7e service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031982 Jul 19 15:53:53.625145 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-748ec271-a0c2-4dd5-bbaf-2a8ee201cb6a tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:53.625461 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 550/1048] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Jul 19 15:53:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:53:53.626915 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-748ec271-a0c2-4dd5-bbaf-2a8ee201cb6a tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:53.627401 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-748ec271-a0c2-4dd5-bbaf-2a8ee201cb6a tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:53.762345 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-748ec271-a0c2-4dd5-bbaf-2a8ee201cb6a tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674d054767ff4eec993ca7fefdce3967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf521f7d98c641d4941eb041acf65405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:53.770671 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-748ec271-a0c2-4dd5-bbaf-2a8ee201cb6a tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] 10.222.0.64 "GET /compute/v2.1/servers/40d79e6b-f23e-47aa-bb6c-04c1a6605256" status: 200 len: 1257 microversion: 2.1 time: 0.157343 Jul 19 15:53:53.771241 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 499/1049] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:53 2022] GET /compute/v2.1/servers/40d79e6b-f23e-47aa-bb6c-04c1a6605256 => generated 1257 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:54.788916 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-3cb59af9-ea44-4862-9259-9571144cd210 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:54.789609 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-3cb59af9-ea44-4862-9259-9571144cd210 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] [instance: 40d79e6b-f23e-47aa-bb6c-04c1a6605256] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:54.796021 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-3cb59af9-ea44-4862-9259-9571144cd210 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:54.796462 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-3cb59af9-ea44-4862-9259-9571144cd210 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:54.797211 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-3cb59af9-ea44-4862-9259-9571144cd210 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:54.797637 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-3cb59af9-ea44-4862-9259-9571144cd210 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:54.932222 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-3cb59af9-ea44-4862-9259-9571144cd210 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674d054767ff4eec993ca7fefdce3967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf521f7d98c641d4941eb041acf65405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:54.939834 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-3cb59af9-ea44-4862-9259-9571144cd210 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] 10.222.0.64 "GET /compute/v2.1/servers/40d79e6b-f23e-47aa-bb6c-04c1a6605256" status: 200 len: 1257 microversion: 2.1 time: 0.156124 Jul 19 15:53:54.940336 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 551/1050] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:54 2022] GET /compute/v2.1/servers/40d79e6b-f23e-47aa-bb6c-04c1a6605256 => generated 1257 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:55.956483 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-0ed8e2e4-2ea8-4b3b-a0d0-09a4cf7a06df tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:55.957972 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-0ed8e2e4-2ea8-4b3b-a0d0-09a4cf7a06df tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] [instance: 40d79e6b-f23e-47aa-bb6c-04c1a6605256] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:55.964479 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-0ed8e2e4-2ea8-4b3b-a0d0-09a4cf7a06df tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:55.964931 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-0ed8e2e4-2ea8-4b3b-a0d0-09a4cf7a06df tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:55.965697 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-0ed8e2e4-2ea8-4b3b-a0d0-09a4cf7a06df tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:55.966134 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-0ed8e2e4-2ea8-4b3b-a0d0-09a4cf7a06df tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:56.157599 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-0ed8e2e4-2ea8-4b3b-a0d0-09a4cf7a06df tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674d054767ff4eec993ca7fefdce3967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf521f7d98c641d4941eb041acf65405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:56.165952 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-0ed8e2e4-2ea8-4b3b-a0d0-09a4cf7a06df tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] 10.222.0.64 "GET /compute/v2.1/servers/40d79e6b-f23e-47aa-bb6c-04c1a6605256" status: 200 len: 1257 microversion: 2.1 time: 0.213315 Jul 19 15:53:56.166552 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 500/1051] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:55 2022] GET /compute/v2.1/servers/40d79e6b-f23e-47aa-bb6c-04c1a6605256 => generated 1257 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:57.183444 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-ec261c6a-832c-47c8-9819-ad8778ff2837 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:57.184445 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-ec261c6a-832c-47c8-9819-ad8778ff2837 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] [instance: 40d79e6b-f23e-47aa-bb6c-04c1a6605256] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:57.194706 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-ec261c6a-832c-47c8-9819-ad8778ff2837 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:57.195450 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-ec261c6a-832c-47c8-9819-ad8778ff2837 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:57.196726 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-ec261c6a-832c-47c8-9819-ad8778ff2837 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:57.197514 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-ec261c6a-832c-47c8-9819-ad8778ff2837 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:57.229977 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG dbcounter [-] [129520] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:53:57.372403 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-ec261c6a-832c-47c8-9819-ad8778ff2837 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674d054767ff4eec993ca7fefdce3967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf521f7d98c641d4941eb041acf65405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:57.374844 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG dbcounter [-] [129520] Writing DB stats nova_cell0:SELECT=2 {{(pid=129520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:53:57.382863 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-ec261c6a-832c-47c8-9819-ad8778ff2837 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] 10.222.0.64 "GET /compute/v2.1/servers/40d79e6b-f23e-47aa-bb6c-04c1a6605256" status: 200 len: 1257 microversion: 2.1 time: 0.203605 Jul 19 15:53:57.383920 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 552/1052] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:57 2022] GET /compute/v2.1/servers/40d79e6b-f23e-47aa-bb6c-04c1a6605256 => generated 1257 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:58.400764 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-5d4b1bd6-e974-4420-8db3-1eb7eea4c79b tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:58.401784 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-5d4b1bd6-e974-4420-8db3-1eb7eea4c79b tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] [instance: 40d79e6b-f23e-47aa-bb6c-04c1a6605256] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:58.405465 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG dbcounter [-] [129519] Writing DB stats nova_cell0:SELECT=2 {{(pid=129519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:53:58.412571 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-5d4b1bd6-e974-4420-8db3-1eb7eea4c79b tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:58.413293 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-5d4b1bd6-e974-4420-8db3-1eb7eea4c79b tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:58.414300 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-5d4b1bd6-e974-4420-8db3-1eb7eea4c79b tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:58.414830 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-5d4b1bd6-e974-4420-8db3-1eb7eea4c79b tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:58.587372 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-5d4b1bd6-e974-4420-8db3-1eb7eea4c79b tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674d054767ff4eec993ca7fefdce3967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf521f7d98c641d4941eb041acf65405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:58.595207 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-5d4b1bd6-e974-4420-8db3-1eb7eea4c79b tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] 10.222.0.64 "GET /compute/v2.1/servers/40d79e6b-f23e-47aa-bb6c-04c1a6605256" status: 200 len: 1257 microversion: 2.1 time: 0.198360 Jul 19 15:53:58.604538 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 501/1053] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:58 2022] GET /compute/v2.1/servers/40d79e6b-f23e-47aa-bb6c-04c1a6605256 => generated 1257 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:53:59.612174 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-1072bcfd-acd8-45eb-88e6-49472ae394c5 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:53:59.612780 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-1072bcfd-acd8-45eb-88e6-49472ae394c5 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] [instance: 40d79e6b-f23e-47aa-bb6c-04c1a6605256] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:53:59.614857 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG dbcounter [-] [129520] Writing DB stats nova_cell0:SELECT=6 {{(pid=129520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:53:59.620584 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-1072bcfd-acd8-45eb-88e6-49472ae394c5 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:59.621031 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-1072bcfd-acd8-45eb-88e6-49472ae394c5 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:59.621797 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-1072bcfd-acd8-45eb-88e6-49472ae394c5 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:53:59.622241 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-1072bcfd-acd8-45eb-88e6-49472ae394c5 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:53:59.772404 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-1072bcfd-acd8-45eb-88e6-49472ae394c5 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674d054767ff4eec993ca7fefdce3967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf521f7d98c641d4941eb041acf65405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:53:59.780693 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-1072bcfd-acd8-45eb-88e6-49472ae394c5 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] 10.222.0.64 "GET /compute/v2.1/servers/40d79e6b-f23e-47aa-bb6c-04c1a6605256" status: 200 len: 1257 microversion: 2.1 time: 0.172493 Jul 19 15:53:59.791580 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 553/1054] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:53:59 2022] GET /compute/v2.1/servers/40d79e6b-f23e-47aa-bb6c-04c1a6605256 => generated 1257 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:00.804982 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-3aa64074-74a5-416a-aad4-f6d1eb6c5422 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:00.807737 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-3aa64074-74a5-416a-aad4-f6d1eb6c5422 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] [instance: 40d79e6b-f23e-47aa-bb6c-04c1a6605256] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:00.820333 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-3aa64074-74a5-416a-aad4-f6d1eb6c5422 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:00.821178 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-3aa64074-74a5-416a-aad4-f6d1eb6c5422 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:00.822193 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-3aa64074-74a5-416a-aad4-f6d1eb6c5422 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:00.822890 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-3aa64074-74a5-416a-aad4-f6d1eb6c5422 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:01.008487 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-3aa64074-74a5-416a-aad4-f6d1eb6c5422 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674d054767ff4eec993ca7fefdce3967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf521f7d98c641d4941eb041acf65405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:01.017579 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-3aa64074-74a5-416a-aad4-f6d1eb6c5422 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] 10.222.0.64 "GET /compute/v2.1/servers/40d79e6b-f23e-47aa-bb6c-04c1a6605256" status: 200 len: 1257 microversion: 2.1 time: 0.220916 Jul 19 15:54:01.025974 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 502/1055] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:00 2022] GET /compute/v2.1/servers/40d79e6b-f23e-47aa-bb6c-04c1a6605256 => generated 1257 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:02.036493 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-0b05411e-cf40-4039-8597-0aee0dea9401 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:02.037189 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-0b05411e-cf40-4039-8597-0aee0dea9401 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] [instance: 40d79e6b-f23e-47aa-bb6c-04c1a6605256] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:02.044628 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-0b05411e-cf40-4039-8597-0aee0dea9401 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:02.045081 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-0b05411e-cf40-4039-8597-0aee0dea9401 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:02.045881 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-0b05411e-cf40-4039-8597-0aee0dea9401 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:02.046323 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-0b05411e-cf40-4039-8597-0aee0dea9401 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:02.197545 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-0b05411e-cf40-4039-8597-0aee0dea9401 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674d054767ff4eec993ca7fefdce3967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf521f7d98c641d4941eb041acf65405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:02.205371 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-0b05411e-cf40-4039-8597-0aee0dea9401 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] 10.222.0.64 "GET /compute/v2.1/servers/40d79e6b-f23e-47aa-bb6c-04c1a6605256" status: 200 len: 1257 microversion: 2.1 time: 0.173137 Jul 19 15:54:02.205937 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 554/1056] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:02 2022] GET /compute/v2.1/servers/40d79e6b-f23e-47aa-bb6c-04c1a6605256 => generated 1257 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:02.977853 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [req-eddf8229-e35a-4857-9104-29330aa58fe2 req-24b48c3e-81e1-4a20-b2a5-3cdfa28b14ef service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40d79e6b-f23e-47aa-bb6c-04c1a6605256", "name": "network-vif-plugged", "status": "completed", "tag": "1afaa31f-2b36-4dde-a958-b15bf3c12a62"}]} {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:54:02.993169 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [req-eddf8229-e35a-4857-9104-29330aa58fe2 req-24b48c3e-81e1-4a20-b2a5-3cdfa28b14ef service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:02.993853 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [req-eddf8229-e35a-4857-9104-29330aa58fe2 req-24b48c3e-81e1-4a20-b2a5-3cdfa28b14ef service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:03.011017 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.compute.server_external_events [req-eddf8229-e35a-4857-9104-29330aa58fe2 req-24b48c3e-81e1-4a20-b2a5-3cdfa28b14ef service nova] Creating event network-vif-plugged:1afaa31f-2b36-4dde-a958-b15bf3c12a62 for instance 40d79e6b-f23e-47aa-bb6c-04c1a6605256 on hv-cinder-84902 Jul 19 15:54:03.017585 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [req-eddf8229-e35a-4857-9104-29330aa58fe2 req-24b48c3e-81e1-4a20-b2a5-3cdfa28b14ef service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044547 Jul 19 15:54:03.021521 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 503/1057] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Jul 19 15:54:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:54:03.226420 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-ed8fa1d5-a9e9-48b5-a22f-570545b42731 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:03.227937 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-ed8fa1d5-a9e9-48b5-a22f-570545b42731 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] [instance: 40d79e6b-f23e-47aa-bb6c-04c1a6605256] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:03.235173 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-ed8fa1d5-a9e9-48b5-a22f-570545b42731 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:03.235946 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-ed8fa1d5-a9e9-48b5-a22f-570545b42731 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:03.236960 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-ed8fa1d5-a9e9-48b5-a22f-570545b42731 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:03.238438 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-ed8fa1d5-a9e9-48b5-a22f-570545b42731 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:03.391338 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-ed8fa1d5-a9e9-48b5-a22f-570545b42731 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674d054767ff4eec993ca7fefdce3967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf521f7d98c641d4941eb041acf65405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:03.400557 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-ed8fa1d5-a9e9-48b5-a22f-570545b42731 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] 10.222.0.64 "GET /compute/v2.1/servers/40d79e6b-f23e-47aa-bb6c-04c1a6605256" status: 200 len: 1257 microversion: 2.1 time: 0.181308 Jul 19 15:54:03.401597 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 555/1058] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:03 2022] GET /compute/v2.1/servers/40d79e6b-f23e-47aa-bb6c-04c1a6605256 => generated 1257 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:54:04.418700 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-b2f1b8f6-4a54-487e-b85b-1a6484c99987 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:04.419605 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-b2f1b8f6-4a54-487e-b85b-1a6484c99987 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] [instance: 40d79e6b-f23e-47aa-bb6c-04c1a6605256] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:04.426624 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-b2f1b8f6-4a54-487e-b85b-1a6484c99987 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:04.427109 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-b2f1b8f6-4a54-487e-b85b-1a6484c99987 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:04.427916 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-b2f1b8f6-4a54-487e-b85b-1a6484c99987 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:04.428372 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-b2f1b8f6-4a54-487e-b85b-1a6484c99987 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:04.577799 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-b2f1b8f6-4a54-487e-b85b-1a6484c99987 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674d054767ff4eec993ca7fefdce3967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf521f7d98c641d4941eb041acf65405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:04.586550 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-b2f1b8f6-4a54-487e-b85b-1a6484c99987 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] 10.222.0.64 "GET /compute/v2.1/servers/40d79e6b-f23e-47aa-bb6c-04c1a6605256" status: 200 len: 1257 microversion: 2.1 time: 0.172478 Jul 19 15:54:04.587133 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 504/1059] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:04 2022] GET /compute/v2.1/servers/40d79e6b-f23e-47aa-bb6c-04c1a6605256 => generated 1257 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:05.605499 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-ba000f1f-b992-4f95-bb5b-450bd1ab5bb7 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:05.606805 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-ba000f1f-b992-4f95-bb5b-450bd1ab5bb7 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] [instance: 40d79e6b-f23e-47aa-bb6c-04c1a6605256] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:05.613709 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-ba000f1f-b992-4f95-bb5b-450bd1ab5bb7 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:05.614247 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-ba000f1f-b992-4f95-bb5b-450bd1ab5bb7 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:05.615146 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-ba000f1f-b992-4f95-bb5b-450bd1ab5bb7 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:05.615719 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-ba000f1f-b992-4f95-bb5b-450bd1ab5bb7 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:05.762325 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-ba000f1f-b992-4f95-bb5b-450bd1ab5bb7 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674d054767ff4eec993ca7fefdce3967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf521f7d98c641d4941eb041acf65405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:05.771489 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-ba000f1f-b992-4f95-bb5b-450bd1ab5bb7 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] 10.222.0.64 "GET /compute/v2.1/servers/40d79e6b-f23e-47aa-bb6c-04c1a6605256" status: 200 len: 1440 microversion: 2.1 time: 0.169907 Jul 19 15:54:05.772066 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 556/1060] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:05 2022] GET /compute/v2.1/servers/40d79e6b-f23e-47aa-bb6c-04c1a6605256 => generated 1440 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:05.792965 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-9c5b1534-d547-47d0-8176-c8d44dbdd4a9 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:05.794647 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-9c5b1534-d547-47d0-8176-c8d44dbdd4a9 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] [instance: 40d79e6b-f23e-47aa-bb6c-04c1a6605256] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:05.802819 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-9c5b1534-d547-47d0-8176-c8d44dbdd4a9 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:05.803973 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-9c5b1534-d547-47d0-8176-c8d44dbdd4a9 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:05.805320 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-9c5b1534-d547-47d0-8176-c8d44dbdd4a9 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:05.805942 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-9c5b1534-d547-47d0-8176-c8d44dbdd4a9 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:05.990624 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-9c5b1534-d547-47d0-8176-c8d44dbdd4a9 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674d054767ff4eec993ca7fefdce3967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf521f7d98c641d4941eb041acf65405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:05.998560 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-9c5b1534-d547-47d0-8176-c8d44dbdd4a9 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] 10.222.0.64 "GET /compute/v2.1/servers/40d79e6b-f23e-47aa-bb6c-04c1a6605256" status: 200 len: 1440 microversion: 2.1 time: 0.210831 Jul 19 15:54:06.012957 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 505/1061] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:05 2022] GET /compute/v2.1/servers/40d79e6b-f23e-47aa-bb6c-04c1a6605256 => generated 1440 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:08.023252 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [req-fdac8821-7d89-49cb-ad05-a51b397ee4da req-67e28463-6316-4409-8b7c-2fe165afe834 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40d79e6b-f23e-47aa-bb6c-04c1a6605256", "tag": "1afaa31f-2b36-4dde-a958-b15bf3c12a62"}]} {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:54:08.032716 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [req-fdac8821-7d89-49cb-ad05-a51b397ee4da req-67e28463-6316-4409-8b7c-2fe165afe834 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:08.033412 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [req-fdac8821-7d89-49cb-ad05-a51b397ee4da req-67e28463-6316-4409-8b7c-2fe165afe834 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:08.046744 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.compute.server_external_events [req-fdac8821-7d89-49cb-ad05-a51b397ee4da req-67e28463-6316-4409-8b7c-2fe165afe834 service nova] Creating event network-changed:1afaa31f-2b36-4dde-a958-b15bf3c12a62 for instance 40d79e6b-f23e-47aa-bb6c-04c1a6605256 on hv-cinder-84902 Jul 19 15:54:08.052768 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [req-fdac8821-7d89-49cb-ad05-a51b397ee4da req-67e28463-6316-4409-8b7c-2fe165afe834 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034880 Jul 19 15:54:08.053596 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 557/1062] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Jul 19 15:54:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:54:35.115464 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-70f5a304-1fce-4722-abf9-99c6e3b00aae tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Action: 'create', calling method: .version_select at 0x7fb8a5a82dc0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1320606493", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDIpT/dGA/BkGiBxT29OHnThqn3BbKbechPQUqqVZWuvY+kRphJWpDUTyfydXyUxvZHdhKQo9etV3cg1QTiVj1Vvn+SwVE0WuHlULkOZUyQ08TWtp8fVHY3wAYkOHilCbA=="}} {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:54:35.119658 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG dbcounter [-] [129519] Writing DB stats nova_api:SELECT=41 {{(pid=129519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:54:35.120524 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG dbcounter [-] [129519] Writing DB stats nova_cell1:SELECT=97 {{(pid=129519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:54:35.133400 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.quota [None req-70f5a304-1fce-4722-abf9-99c6e3b00aae tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Getting quotas for project 6a9e5f3b931d47b6bfb7938a89c2a37d. Resources: {'key_pairs'} {{(pid=129519) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 15:54:35.137284 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.quota [None req-70f5a304-1fce-4722-abf9-99c6e3b00aae tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Getting quotas for user 8a63627dc4624d9c8b73bcbfcc11fbf8 and project 6a9e5f3b931d47b6bfb7938a89c2a37d. Resources: {'key_pairs'} {{(pid=129519) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 15:54:35.158731 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-70f5a304-1fce-4722-abf9-99c6e3b00aae tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] 10.222.0.64 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.047435 Jul 19 15:54:35.159950 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 506/1063] 10.222.0.64 () {60 vars in 1158 bytes} [Tue Jul 19 15:54:35 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:54:35.205712 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG dbcounter [-] [129520] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=129520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:54:35.206663 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG dbcounter [-] [129520] Writing DB stats nova_cell1:SELECT=28 {{(pid=129520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:54:35.211016 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-f918a411-8808-4bd0-9c3b-0bc2cabed63f tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-98899304", "imageRef": "7dd14e64-bfb1-43b4-92d1-c012d4d06e83", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1320606493", "networks": [{"uuid": "79877616-2837-475b-9882-e49c1f1a3a64"}]}} {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:54:35.267486 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.network.neutron [None req-f918a411-8808-4bd0-9c3b-0bc2cabed63f tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] validate_networks() for [('79877616-2837-475b-9882-e49c1f1a3a64', None, None, None, None, None)] {{(pid=129520) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 19 15:54:35.640354 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.virt.hardware [None req-f918a411-8808-4bd0-9c3b-0bc2cabed63f tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Flavor limits 0:0:0 {{(pid=129520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 19 15:54:35.640775 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.virt.hardware [None req-f918a411-8808-4bd0-9c3b-0bc2cabed63f tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Image limits 0:0:0 {{(pid=129520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 19 15:54:35.641249 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.virt.hardware [None req-f918a411-8808-4bd0-9c3b-0bc2cabed63f tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Flavor pref 0:0:0 {{(pid=129520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 19 15:54:35.641659 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.virt.hardware [None req-f918a411-8808-4bd0-9c3b-0bc2cabed63f tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Image pref 0:0:0 {{(pid=129520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 19 15:54:35.642071 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.virt.hardware [None req-f918a411-8808-4bd0-9c3b-0bc2cabed63f tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=129520) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 19 15:54:35.651661 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-f918a411-8808-4bd0-9c3b-0bc2cabed63f tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:35.652113 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-f918a411-8808-4bd0-9c3b-0bc2cabed63f tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:35.652909 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-f918a411-8808-4bd0-9c3b-0bc2cabed63f tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:35.653345 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-f918a411-8808-4bd0-9c3b-0bc2cabed63f tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:35.670723 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.quota [None req-f918a411-8808-4bd0-9c3b-0bc2cabed63f tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Getting quotas for project 6a9e5f3b931d47b6bfb7938a89c2a37d. Resources: {'ram', 'instances', 'cores'} {{(pid=129520) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 19 15:54:35.674860 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.quota [None req-f918a411-8808-4bd0-9c3b-0bc2cabed63f tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Getting quotas for user 8a63627dc4624d9c8b73bcbfcc11fbf8 and project 6a9e5f3b931d47b6bfb7938a89c2a37d. Resources: {'ram', 'instances', 'cores'} {{(pid=129520) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 19 15:54:35.685848 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-f918a411-8808-4bd0-9c3b-0bc2cabed63f tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Going to run 1 instances... {{(pid=129520) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 19 15:54:35.688180 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-f918a411-8808-4bd0-9c3b-0bc2cabed63f tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] [instance: 6a682004-8d98-4d3d-ad12-a1cf82bbaf1e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='7dd14e64-bfb1-43b4-92d1-c012d4d06e83',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=129520) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 19 15:54:35.734730 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-f918a411-8808-4bd0-9c3b-0bc2cabed63f tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] 10.222.0.64 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.530583 Jul 19 15:54:35.735377 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 558/1064] 10.222.0.64 () {60 vars in 1146 bytes} [Tue Jul 19 15:54:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 532 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 19 15:54:35.745216 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-2b8b1a18-ef9b-4f3a-9e9d-60764fee9766 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:35.745862 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-2b8b1a18-ef9b-4f3a-9e9d-60764fee9766 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] [instance: 6a682004-8d98-4d3d-ad12-a1cf82bbaf1e] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:35.799679 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-2b8b1a18-ef9b-4f3a-9e9d-60764fee9766 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a63627dc4624d9c8b73bcbfcc11fbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9e5f3b931d47b6bfb7938a89c2a37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:35.806816 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-2b8b1a18-ef9b-4f3a-9e9d-60764fee9766 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] 10.222.0.64 "GET /compute/v2.1/servers/6a682004-8d98-4d3d-ad12-a1cf82bbaf1e" status: 200 len: 1257 microversion: 2.1 time: 0.065433 Jul 19 15:54:35.807392 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 507/1065] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:35 2022] GET /compute/v2.1/servers/6a682004-8d98-4d3d-ad12-a1cf82bbaf1e => generated 1257 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:36.825041 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-45954e03-c765-400a-827b-8de3e644b92b tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:36.825773 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-45954e03-c765-400a-827b-8de3e644b92b tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] [instance: 6a682004-8d98-4d3d-ad12-a1cf82bbaf1e] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:36.833957 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-45954e03-c765-400a-827b-8de3e644b92b tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:36.834458 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-45954e03-c765-400a-827b-8de3e644b92b tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:36.835252 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-45954e03-c765-400a-827b-8de3e644b92b tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:36.835691 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-45954e03-c765-400a-827b-8de3e644b92b tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:36.901975 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-45954e03-c765-400a-827b-8de3e644b92b tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a63627dc4624d9c8b73bcbfcc11fbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9e5f3b931d47b6bfb7938a89c2a37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:36.910963 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-45954e03-c765-400a-827b-8de3e644b92b tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] 10.222.0.64 "GET /compute/v2.1/servers/6a682004-8d98-4d3d-ad12-a1cf82bbaf1e" status: 200 len: 1315 microversion: 2.1 time: 0.090237 Jul 19 15:54:36.914695 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 559/1066] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:36 2022] GET /compute/v2.1/servers/6a682004-8d98-4d3d-ad12-a1cf82bbaf1e => generated 1315 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:37.929755 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-42f55299-c566-4f8c-9cc8-5eab4860a003 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:37.930556 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-42f55299-c566-4f8c-9cc8-5eab4860a003 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] [instance: 6a682004-8d98-4d3d-ad12-a1cf82bbaf1e] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:37.938209 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-42f55299-c566-4f8c-9cc8-5eab4860a003 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:37.938683 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-42f55299-c566-4f8c-9cc8-5eab4860a003 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:37.939451 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-42f55299-c566-4f8c-9cc8-5eab4860a003 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:37.939886 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-42f55299-c566-4f8c-9cc8-5eab4860a003 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:38.080243 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-42f55299-c566-4f8c-9cc8-5eab4860a003 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a63627dc4624d9c8b73bcbfcc11fbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9e5f3b931d47b6bfb7938a89c2a37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:38.088329 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-42f55299-c566-4f8c-9cc8-5eab4860a003 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] 10.222.0.64 "GET /compute/v2.1/servers/6a682004-8d98-4d3d-ad12-a1cf82bbaf1e" status: 200 len: 1357 microversion: 2.1 time: 0.162558 Jul 19 15:54:38.089036 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 508/1067] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:37 2022] GET /compute/v2.1/servers/6a682004-8d98-4d3d-ad12-a1cf82bbaf1e => generated 1357 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:39.107657 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-a5922997-52da-47ac-bb9f-48e0b2ff823f tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:39.108272 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-a5922997-52da-47ac-bb9f-48e0b2ff823f tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] [instance: 6a682004-8d98-4d3d-ad12-a1cf82bbaf1e] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:39.115938 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-a5922997-52da-47ac-bb9f-48e0b2ff823f tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:39.116395 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-a5922997-52da-47ac-bb9f-48e0b2ff823f tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:39.117174 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-a5922997-52da-47ac-bb9f-48e0b2ff823f tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:39.117794 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-a5922997-52da-47ac-bb9f-48e0b2ff823f tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:39.255234 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-a5922997-52da-47ac-bb9f-48e0b2ff823f tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a63627dc4624d9c8b73bcbfcc11fbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9e5f3b931d47b6bfb7938a89c2a37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:39.263002 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-a5922997-52da-47ac-bb9f-48e0b2ff823f tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] 10.222.0.64 "GET /compute/v2.1/servers/6a682004-8d98-4d3d-ad12-a1cf82bbaf1e" status: 200 len: 1357 microversion: 2.1 time: 0.159239 Jul 19 15:54:39.263571 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 560/1068] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:39 2022] GET /compute/v2.1/servers/6a682004-8d98-4d3d-ad12-a1cf82bbaf1e => generated 1357 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:40.280937 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-c0ba1fea-3fcb-401d-b1e5-427400e197f5 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:40.281696 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-c0ba1fea-3fcb-401d-b1e5-427400e197f5 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] [instance: 6a682004-8d98-4d3d-ad12-a1cf82bbaf1e] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:40.289119 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-c0ba1fea-3fcb-401d-b1e5-427400e197f5 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:40.289712 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-c0ba1fea-3fcb-401d-b1e5-427400e197f5 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:40.292857 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-c0ba1fea-3fcb-401d-b1e5-427400e197f5 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:40.293592 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-c0ba1fea-3fcb-401d-b1e5-427400e197f5 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:40.460842 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-c0ba1fea-3fcb-401d-b1e5-427400e197f5 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a63627dc4624d9c8b73bcbfcc11fbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9e5f3b931d47b6bfb7938a89c2a37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:40.468348 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-c0ba1fea-3fcb-401d-b1e5-427400e197f5 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] 10.222.0.64 "GET /compute/v2.1/servers/6a682004-8d98-4d3d-ad12-a1cf82bbaf1e" status: 200 len: 1357 microversion: 2.1 time: 0.191930 Jul 19 15:54:40.469035 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 509/1069] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:40 2022] GET /compute/v2.1/servers/6a682004-8d98-4d3d-ad12-a1cf82bbaf1e => generated 1357 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:41.488136 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-224c4425-d85c-4ba9-b14d-c0ffeecbc0fd tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:41.488886 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-224c4425-d85c-4ba9-b14d-c0ffeecbc0fd tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] [instance: 6a682004-8d98-4d3d-ad12-a1cf82bbaf1e] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:41.495612 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-224c4425-d85c-4ba9-b14d-c0ffeecbc0fd tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:41.496061 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-224c4425-d85c-4ba9-b14d-c0ffeecbc0fd tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:41.496835 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-224c4425-d85c-4ba9-b14d-c0ffeecbc0fd tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:41.497273 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-224c4425-d85c-4ba9-b14d-c0ffeecbc0fd tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:41.639053 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-224c4425-d85c-4ba9-b14d-c0ffeecbc0fd tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a63627dc4624d9c8b73bcbfcc11fbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9e5f3b931d47b6bfb7938a89c2a37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:41.646917 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-224c4425-d85c-4ba9-b14d-c0ffeecbc0fd tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] 10.222.0.64 "GET /compute/v2.1/servers/6a682004-8d98-4d3d-ad12-a1cf82bbaf1e" status: 200 len: 1357 microversion: 2.1 time: 0.163193 Jul 19 15:54:41.647493 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 561/1070] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:41 2022] GET /compute/v2.1/servers/6a682004-8d98-4d3d-ad12-a1cf82bbaf1e => generated 1357 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:42.665107 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-7044f2ab-91b1-41f4-92dd-95a1bf5fbcf3 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:42.665963 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-7044f2ab-91b1-41f4-92dd-95a1bf5fbcf3 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] [instance: 6a682004-8d98-4d3d-ad12-a1cf82bbaf1e] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:42.676302 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-7044f2ab-91b1-41f4-92dd-95a1bf5fbcf3 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:42.676973 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-7044f2ab-91b1-41f4-92dd-95a1bf5fbcf3 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:42.678335 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-7044f2ab-91b1-41f4-92dd-95a1bf5fbcf3 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:42.678905 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-7044f2ab-91b1-41f4-92dd-95a1bf5fbcf3 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:42.824261 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-7044f2ab-91b1-41f4-92dd-95a1bf5fbcf3 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a63627dc4624d9c8b73bcbfcc11fbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9e5f3b931d47b6bfb7938a89c2a37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:42.832159 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-7044f2ab-91b1-41f4-92dd-95a1bf5fbcf3 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] 10.222.0.64 "GET /compute/v2.1/servers/6a682004-8d98-4d3d-ad12-a1cf82bbaf1e" status: 200 len: 1357 microversion: 2.1 time: 0.171011 Jul 19 15:54:42.832746 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 510/1071] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:42 2022] GET /compute/v2.1/servers/6a682004-8d98-4d3d-ad12-a1cf82bbaf1e => generated 1357 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:54:43.849706 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-5f02bdfb-3b41-4346-a609-4c59c17ddc53 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:43.850398 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-5f02bdfb-3b41-4346-a609-4c59c17ddc53 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] [instance: 6a682004-8d98-4d3d-ad12-a1cf82bbaf1e] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:43.856853 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-5f02bdfb-3b41-4346-a609-4c59c17ddc53 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:43.857301 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-5f02bdfb-3b41-4346-a609-4c59c17ddc53 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:43.858109 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-5f02bdfb-3b41-4346-a609-4c59c17ddc53 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:43.858528 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-5f02bdfb-3b41-4346-a609-4c59c17ddc53 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:44.012812 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-5f02bdfb-3b41-4346-a609-4c59c17ddc53 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a63627dc4624d9c8b73bcbfcc11fbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9e5f3b931d47b6bfb7938a89c2a37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:44.020767 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-5f02bdfb-3b41-4346-a609-4c59c17ddc53 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] 10.222.0.64 "GET /compute/v2.1/servers/6a682004-8d98-4d3d-ad12-a1cf82bbaf1e" status: 200 len: 1357 microversion: 2.1 time: 0.175210 Jul 19 15:54:44.021540 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 562/1072] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:43 2022] GET /compute/v2.1/servers/6a682004-8d98-4d3d-ad12-a1cf82bbaf1e => generated 1357 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:45.039193 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-e85a7c0e-d0bf-4c02-8ba5-945c236d0c32 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:45.040678 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-e85a7c0e-d0bf-4c02-8ba5-945c236d0c32 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] [instance: 6a682004-8d98-4d3d-ad12-a1cf82bbaf1e] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:45.048051 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-e85a7c0e-d0bf-4c02-8ba5-945c236d0c32 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:45.048504 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-e85a7c0e-d0bf-4c02-8ba5-945c236d0c32 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:45.049301 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-e85a7c0e-d0bf-4c02-8ba5-945c236d0c32 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:45.049851 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-e85a7c0e-d0bf-4c02-8ba5-945c236d0c32 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:45.180402 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-e85a7c0e-d0bf-4c02-8ba5-945c236d0c32 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a63627dc4624d9c8b73bcbfcc11fbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9e5f3b931d47b6bfb7938a89c2a37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:45.187863 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-e85a7c0e-d0bf-4c02-8ba5-945c236d0c32 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] 10.222.0.64 "GET /compute/v2.1/servers/6a682004-8d98-4d3d-ad12-a1cf82bbaf1e" status: 200 len: 1357 microversion: 2.1 time: 0.153479 Jul 19 15:54:45.188426 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 511/1073] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:45 2022] GET /compute/v2.1/servers/6a682004-8d98-4d3d-ad12-a1cf82bbaf1e => generated 1357 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:45.961143 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [req-20869158-5b43-4057-84fc-45edc53cc69b req-d62fa226-fb44-4669-ad19-95d64627f41c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a682004-8d98-4d3d-ad12-a1cf82bbaf1e", "tag": "818b1333-97cf-4dc6-b490-98d025379610"}]} {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:54:45.970864 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG dbcounter [-] [129520] Writing DB stats nova_cell0:SELECT=2 {{(pid=129520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:54:45.973219 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG dbcounter [-] [129520] Writing DB stats nova_cell0:SELECT=6 {{(pid=129520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:54:45.985738 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [req-20869158-5b43-4057-84fc-45edc53cc69b req-d62fa226-fb44-4669-ad19-95d64627f41c service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:45.986191 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [req-20869158-5b43-4057-84fc-45edc53cc69b req-d62fa226-fb44-4669-ad19-95d64627f41c service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:45.998540 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.compute.server_external_events [req-20869158-5b43-4057-84fc-45edc53cc69b req-d62fa226-fb44-4669-ad19-95d64627f41c service nova] Creating event network-changed:818b1333-97cf-4dc6-b490-98d025379610 for instance 6a682004-8d98-4d3d-ad12-a1cf82bbaf1e on hv-cinder-84902 Jul 19 15:54:46.004753 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [req-20869158-5b43-4057-84fc-45edc53cc69b req-d62fa226-fb44-4669-ad19-95d64627f41c service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049455 Jul 19 15:54:46.005365 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 563/1074] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Jul 19 15:54:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:54:46.204483 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-5df9fec1-00c7-41d9-967a-e1a54493bfcd tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:46.205169 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-5df9fec1-00c7-41d9-967a-e1a54493bfcd tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] [instance: 6a682004-8d98-4d3d-ad12-a1cf82bbaf1e] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:46.207261 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG dbcounter [-] [129519] Writing DB stats nova_cell0:SELECT=6 {{(pid=129519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:54:46.213226 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-5df9fec1-00c7-41d9-967a-e1a54493bfcd tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:46.213672 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-5df9fec1-00c7-41d9-967a-e1a54493bfcd tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:46.214454 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-5df9fec1-00c7-41d9-967a-e1a54493bfcd tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:46.214883 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-5df9fec1-00c7-41d9-967a-e1a54493bfcd tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:46.402642 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-5df9fec1-00c7-41d9-967a-e1a54493bfcd tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a63627dc4624d9c8b73bcbfcc11fbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9e5f3b931d47b6bfb7938a89c2a37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:46.411648 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-5df9fec1-00c7-41d9-967a-e1a54493bfcd tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] 10.222.0.64 "GET /compute/v2.1/servers/6a682004-8d98-4d3d-ad12-a1cf82bbaf1e" status: 200 len: 1357 microversion: 2.1 time: 0.210969 Jul 19 15:54:46.412312 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 512/1075] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:46 2022] GET /compute/v2.1/servers/6a682004-8d98-4d3d-ad12-a1cf82bbaf1e => generated 1357 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:47.429586 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-a55bcd36-30b4-4cef-a5d1-5e0d37483ea3 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:47.430315 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-a55bcd36-30b4-4cef-a5d1-5e0d37483ea3 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] [instance: 6a682004-8d98-4d3d-ad12-a1cf82bbaf1e] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:47.436485 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-a55bcd36-30b4-4cef-a5d1-5e0d37483ea3 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:47.436926 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-a55bcd36-30b4-4cef-a5d1-5e0d37483ea3 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:47.437686 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-a55bcd36-30b4-4cef-a5d1-5e0d37483ea3 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:47.438120 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-a55bcd36-30b4-4cef-a5d1-5e0d37483ea3 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:47.573222 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-a55bcd36-30b4-4cef-a5d1-5e0d37483ea3 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a63627dc4624d9c8b73bcbfcc11fbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9e5f3b931d47b6bfb7938a89c2a37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:47.580833 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-a55bcd36-30b4-4cef-a5d1-5e0d37483ea3 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] 10.222.0.64 "GET /compute/v2.1/servers/6a682004-8d98-4d3d-ad12-a1cf82bbaf1e" status: 200 len: 1357 microversion: 2.1 time: 0.156532 Jul 19 15:54:47.581572 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 564/1076] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:47 2022] GET /compute/v2.1/servers/6a682004-8d98-4d3d-ad12-a1cf82bbaf1e => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:48.597211 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-ba7575a7-2e4a-4b7d-99b7-72c476e704f5 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:48.597813 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-ba7575a7-2e4a-4b7d-99b7-72c476e704f5 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] [instance: 6a682004-8d98-4d3d-ad12-a1cf82bbaf1e] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:48.604385 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-ba7575a7-2e4a-4b7d-99b7-72c476e704f5 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:48.604830 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-ba7575a7-2e4a-4b7d-99b7-72c476e704f5 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:48.605584 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-ba7575a7-2e4a-4b7d-99b7-72c476e704f5 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:48.606018 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-ba7575a7-2e4a-4b7d-99b7-72c476e704f5 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:48.745380 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-ba7575a7-2e4a-4b7d-99b7-72c476e704f5 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a63627dc4624d9c8b73bcbfcc11fbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9e5f3b931d47b6bfb7938a89c2a37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:48.753266 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-ba7575a7-2e4a-4b7d-99b7-72c476e704f5 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] 10.222.0.64 "GET /compute/v2.1/servers/6a682004-8d98-4d3d-ad12-a1cf82bbaf1e" status: 200 len: 1357 microversion: 2.1 time: 0.159648 Jul 19 15:54:48.753922 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 513/1077] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:48 2022] GET /compute/v2.1/servers/6a682004-8d98-4d3d-ad12-a1cf82bbaf1e => generated 1357 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:49.770937 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-1962a995-471c-414e-afa4-2ea342d522b5 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:49.771473 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-1962a995-471c-414e-afa4-2ea342d522b5 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] [instance: 6a682004-8d98-4d3d-ad12-a1cf82bbaf1e] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:49.778017 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-1962a995-471c-414e-afa4-2ea342d522b5 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:49.778517 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-1962a995-471c-414e-afa4-2ea342d522b5 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:49.779281 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-1962a995-471c-414e-afa4-2ea342d522b5 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:49.779712 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-1962a995-471c-414e-afa4-2ea342d522b5 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:49.905592 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-1962a995-471c-414e-afa4-2ea342d522b5 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a63627dc4624d9c8b73bcbfcc11fbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9e5f3b931d47b6bfb7938a89c2a37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:49.913847 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-1962a995-471c-414e-afa4-2ea342d522b5 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] 10.222.0.64 "GET /compute/v2.1/servers/6a682004-8d98-4d3d-ad12-a1cf82bbaf1e" status: 200 len: 1357 microversion: 2.1 time: 0.147605 Jul 19 15:54:49.914432 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 565/1078] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:49 2022] GET /compute/v2.1/servers/6a682004-8d98-4d3d-ad12-a1cf82bbaf1e => generated 1357 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:50.932020 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-c388c635-f50a-46c4-9ec8-12596cd65f76 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:50.932626 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-c388c635-f50a-46c4-9ec8-12596cd65f76 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] [instance: 6a682004-8d98-4d3d-ad12-a1cf82bbaf1e] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:50.939376 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-c388c635-f50a-46c4-9ec8-12596cd65f76 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:50.939769 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-c388c635-f50a-46c4-9ec8-12596cd65f76 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:50.940613 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-c388c635-f50a-46c4-9ec8-12596cd65f76 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:50.941061 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-c388c635-f50a-46c4-9ec8-12596cd65f76 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:51.100412 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-c388c635-f50a-46c4-9ec8-12596cd65f76 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a63627dc4624d9c8b73bcbfcc11fbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9e5f3b931d47b6bfb7938a89c2a37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:51.108737 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-c388c635-f50a-46c4-9ec8-12596cd65f76 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] 10.222.0.64 "GET /compute/v2.1/servers/6a682004-8d98-4d3d-ad12-a1cf82bbaf1e" status: 200 len: 1357 microversion: 2.1 time: 0.180558 Jul 19 15:54:51.109358 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 514/1079] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:50 2022] GET /compute/v2.1/servers/6a682004-8d98-4d3d-ad12-a1cf82bbaf1e => generated 1357 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:51.236889 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [req-be911083-b78d-47f6-8eea-c6410adee088 req-ae047aa1-453d-4473-a4e9-2794886d88aa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a682004-8d98-4d3d-ad12-a1cf82bbaf1e", "name": "network-vif-plugged", "status": "completed", "tag": "818b1333-97cf-4dc6-b490-98d025379610"}]} {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:54:51.245753 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [req-be911083-b78d-47f6-8eea-c6410adee088 req-ae047aa1-453d-4473-a4e9-2794886d88aa service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:51.246284 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [req-be911083-b78d-47f6-8eea-c6410adee088 req-ae047aa1-453d-4473-a4e9-2794886d88aa service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:51.257746 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.compute.server_external_events [req-be911083-b78d-47f6-8eea-c6410adee088 req-ae047aa1-453d-4473-a4e9-2794886d88aa service nova] Creating event network-vif-plugged:818b1333-97cf-4dc6-b490-98d025379610 for instance 6a682004-8d98-4d3d-ad12-a1cf82bbaf1e on hv-cinder-84902 Jul 19 15:54:51.262655 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [req-be911083-b78d-47f6-8eea-c6410adee088 req-ae047aa1-453d-4473-a4e9-2794886d88aa service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029875 Jul 19 15:54:51.263242 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 566/1080] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Jul 19 15:54:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:54:52.126470 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-faa8e62a-b8b6-4824-af4a-76f45134694e tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:52.127059 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-faa8e62a-b8b6-4824-af4a-76f45134694e tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] [instance: 6a682004-8d98-4d3d-ad12-a1cf82bbaf1e] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:52.134167 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-faa8e62a-b8b6-4824-af4a-76f45134694e tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:52.134593 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-faa8e62a-b8b6-4824-af4a-76f45134694e tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:52.135344 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-faa8e62a-b8b6-4824-af4a-76f45134694e tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:52.135771 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-faa8e62a-b8b6-4824-af4a-76f45134694e tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:52.273493 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-faa8e62a-b8b6-4824-af4a-76f45134694e tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a63627dc4624d9c8b73bcbfcc11fbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9e5f3b931d47b6bfb7938a89c2a37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:52.280837 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-faa8e62a-b8b6-4824-af4a-76f45134694e tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] 10.222.0.64 "GET /compute/v2.1/servers/6a682004-8d98-4d3d-ad12-a1cf82bbaf1e" status: 200 len: 1357 microversion: 2.1 time: 0.158276 Jul 19 15:54:52.281402 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 515/1081] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:52 2022] GET /compute/v2.1/servers/6a682004-8d98-4d3d-ad12-a1cf82bbaf1e => generated 1357 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:53.298800 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-03c97d05-1a1b-43f4-afb4-edcc04a8572e tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:53.299491 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-03c97d05-1a1b-43f4-afb4-edcc04a8572e tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] [instance: 6a682004-8d98-4d3d-ad12-a1cf82bbaf1e] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:53.305879 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-03c97d05-1a1b-43f4-afb4-edcc04a8572e tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:53.306326 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-03c97d05-1a1b-43f4-afb4-edcc04a8572e tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:53.307099 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-03c97d05-1a1b-43f4-afb4-edcc04a8572e tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:53.307533 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-03c97d05-1a1b-43f4-afb4-edcc04a8572e tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:53.439901 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-03c97d05-1a1b-43f4-afb4-edcc04a8572e tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a63627dc4624d9c8b73bcbfcc11fbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9e5f3b931d47b6bfb7938a89c2a37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:53.447883 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-03c97d05-1a1b-43f4-afb4-edcc04a8572e tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] 10.222.0.64 "GET /compute/v2.1/servers/6a682004-8d98-4d3d-ad12-a1cf82bbaf1e" status: 200 len: 1547 microversion: 2.1 time: 0.153827 Jul 19 15:54:53.448439 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 567/1082] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:53 2022] GET /compute/v2.1/servers/6a682004-8d98-4d3d-ad12-a1cf82bbaf1e => generated 1547 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:53.463657 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-ef2b153e-ea7d-4a41-b4ae-c0723e501afe tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:53.464262 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-ef2b153e-ea7d-4a41-b4ae-c0723e501afe tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] [instance: 6a682004-8d98-4d3d-ad12-a1cf82bbaf1e] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:53.470708 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-ef2b153e-ea7d-4a41-b4ae-c0723e501afe tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:53.471151 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-ef2b153e-ea7d-4a41-b4ae-c0723e501afe tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:53.472099 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-ef2b153e-ea7d-4a41-b4ae-c0723e501afe tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:53.472422 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-ef2b153e-ea7d-4a41-b4ae-c0723e501afe tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:53.601475 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-ef2b153e-ea7d-4a41-b4ae-c0723e501afe tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a63627dc4624d9c8b73bcbfcc11fbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9e5f3b931d47b6bfb7938a89c2a37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:53.608947 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-ef2b153e-ea7d-4a41-b4ae-c0723e501afe tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] 10.222.0.64 "GET /compute/v2.1/servers/6a682004-8d98-4d3d-ad12-a1cf82bbaf1e" status: 200 len: 1547 microversion: 2.1 time: 0.149165 Jul 19 15:54:53.609561 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 516/1083] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:53 2022] GET /compute/v2.1/servers/6a682004-8d98-4d3d-ad12-a1cf82bbaf1e => generated 1547 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:53.624926 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-e799f5a5-9e9c-49d5-a5e5-2c03832b44d1 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:53.628590 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-e799f5a5-9e9c-49d5-a5e5-2c03832b44d1 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '8a63627dc4624d9c8b73bcbfcc11fbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9e5f3b931d47b6bfb7938a89c2a37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:53.629415 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-e799f5a5-9e9c-49d5-a5e5-2c03832b44d1 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Searching by: {'deleted': False, 'project_id': '6a9e5f3b931d47b6bfb7938a89c2a37d'} {{(pid=129520) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 19 15:54:53.636076 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-e799f5a5-9e9c-49d5-a5e5-2c03832b44d1 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:53.636522 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-e799f5a5-9e9c-49d5-a5e5-2c03832b44d1 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:53.637315 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-e799f5a5-9e9c-49d5-a5e5-2c03832b44d1 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:53.637755 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-e799f5a5-9e9c-49d5-a5e5-2c03832b44d1 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:53.729036 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.multi_cell_list [None req-e799f5a5-9e9c-49d5-a5e5-2c03832b44d1 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=129520) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 19 15:54:53.819685 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-e799f5a5-9e9c-49d5-a5e5-2c03832b44d1 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] 10.222.0.64 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.198375 Jul 19 15:54:53.820166 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 568/1084] 10.222.0.64 () {58 vars in 1124 bytes} [Tue Jul 19 15:54:53 2022] GET /compute/v2.1/servers => generated 341 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:54:53.830133 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-b6aff2ac-fb22-4d61-bc26-82e402a3e771 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:54:53.830822 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-b6aff2ac-fb22-4d61-bc26-82e402a3e771 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] [instance: 6a682004-8d98-4d3d-ad12-a1cf82bbaf1e] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:53.837436 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-b6aff2ac-fb22-4d61-bc26-82e402a3e771 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:53.837877 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-b6aff2ac-fb22-4d61-bc26-82e402a3e771 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:53.838650 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-b6aff2ac-fb22-4d61-bc26-82e402a3e771 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:53.839080 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-b6aff2ac-fb22-4d61-bc26-82e402a3e771 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:53.966490 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-b6aff2ac-fb22-4d61-bc26-82e402a3e771 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a63627dc4624d9c8b73bcbfcc11fbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9e5f3b931d47b6bfb7938a89c2a37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:54:53.974137 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-b6aff2ac-fb22-4d61-bc26-82e402a3e771 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] 10.222.0.64 "GET /compute/v2.1/servers/6a682004-8d98-4d3d-ad12-a1cf82bbaf1e" status: 200 len: 1547 microversion: 2.1 time: 0.147770 Jul 19 15:54:53.974726 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 517/1085] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:54:53 2022] GET /compute/v2.1/servers/6a682004-8d98-4d3d-ad12-a1cf82bbaf1e => generated 1547 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:54:55.486310 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-ead64413-a465-4d68-805d-3a464cbbf6f7 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1a512744-7971-4776-9b81-8cb304eeb3d8"}} {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:54:55.487442 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-ead64413-a465-4d68-805d-3a464cbbf6f7 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] [instance: 6a682004-8d98-4d3d-ad12-a1cf82bbaf1e] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:54:55.494917 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-ead64413-a465-4d68-805d-3a464cbbf6f7 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:55.495371 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-ead64413-a465-4d68-805d-3a464cbbf6f7 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:55.496132 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-ead64413-a465-4d68-805d-3a464cbbf6f7 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:54:55.496571 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-ead64413-a465-4d68-805d-3a464cbbf6f7 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:54:55.735165 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-ead64413-a465-4d68-805d-3a464cbbf6f7 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] 10.222.0.64 "POST /compute/v2.1/servers/6a682004-8d98-4d3d-ad12-a1cf82bbaf1e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.252662 Jul 19 15:54:55.735805 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 569/1086] 10.222.0.64 () {60 vars in 1322 bytes} [Tue Jul 19 15:54:55 2022] POST /compute/v2.1/servers/6a682004-8d98-4d3d-ad12-a1cf82bbaf1e/os-volume_attachments => generated 194 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:55:02.227349 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-25a03fc9-736a-4bc4-b996-dfb5a68f05f4 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:02.227946 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-25a03fc9-736a-4bc4-b996-dfb5a68f05f4 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] [instance: 6a682004-8d98-4d3d-ad12-a1cf82bbaf1e] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:02.234524 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-25a03fc9-736a-4bc4-b996-dfb5a68f05f4 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:02.234967 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-25a03fc9-736a-4bc4-b996-dfb5a68f05f4 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:02.235716 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-25a03fc9-736a-4bc4-b996-dfb5a68f05f4 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:02.236152 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-25a03fc9-736a-4bc4-b996-dfb5a68f05f4 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:02.367815 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-25a03fc9-736a-4bc4-b996-dfb5a68f05f4 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a63627dc4624d9c8b73bcbfcc11fbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9e5f3b931d47b6bfb7938a89c2a37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:55:02.375762 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-25a03fc9-736a-4bc4-b996-dfb5a68f05f4 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] 10.222.0.64 "GET /compute/v2.1/servers/6a682004-8d98-4d3d-ad12-a1cf82bbaf1e" status: 200 len: 1593 microversion: 2.1 time: 0.152183 Jul 19 15:55:02.376332 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 518/1087] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:55:02 2022] GET /compute/v2.1/servers/6a682004-8d98-4d3d-ad12-a1cf82bbaf1e => generated 1593 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:55:04.291829 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG dbcounter [-] [129520] Writing DB stats nova_cell0:SELECT=2 {{(pid=129520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:55:04.296616 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [req-900336d5-5977-45ca-ac39-a34e9ffc090c req-77ba3abb-2147-4a60-a720-d408b70850e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a682004-8d98-4d3d-ad12-a1cf82bbaf1e", "tag": "818b1333-97cf-4dc6-b490-98d025379610"}]} {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:55:04.307340 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [req-900336d5-5977-45ca-ac39-a34e9ffc090c req-77ba3abb-2147-4a60-a720-d408b70850e2 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:04.307864 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [req-900336d5-5977-45ca-ac39-a34e9ffc090c req-77ba3abb-2147-4a60-a720-d408b70850e2 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:04.322710 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.compute.server_external_events [req-900336d5-5977-45ca-ac39-a34e9ffc090c req-77ba3abb-2147-4a60-a720-d408b70850e2 service nova] Creating event network-changed:818b1333-97cf-4dc6-b490-98d025379610 for instance 6a682004-8d98-4d3d-ad12-a1cf82bbaf1e on hv-cinder-84902 Jul 19 15:55:04.328795 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [req-900336d5-5977-45ca-ac39-a34e9ffc090c req-77ba3abb-2147-4a60-a720-d408b70850e2 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037959 Jul 19 15:55:04.329633 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 570/1088] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Jul 19 15:55:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:55:05.494663 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-d46d78d5-5e31-42e6-9b12-6b5d3102078f tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1693911727"}} {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:55:05.495204 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-d46d78d5-5e31-42e6-9b12-6b5d3102078f tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] [instance: 6a682004-8d98-4d3d-ad12-a1cf82bbaf1e] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:05.497269 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG dbcounter [-] [129519] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=129519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:55:05.502708 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-d46d78d5-5e31-42e6-9b12-6b5d3102078f tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:05.503159 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-d46d78d5-5e31-42e6-9b12-6b5d3102078f tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:05.504043 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-d46d78d5-5e31-42e6-9b12-6b5d3102078f tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:05.504478 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-d46d78d5-5e31-42e6-9b12-6b5d3102078f tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:05.508975 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG dbcounter [-] [129519] Writing DB stats nova_cell1:SELECT=67 {{(pid=129519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:55:05.637982 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.network.security_group_api [None req-d46d78d5-5e31-42e6-9b12-6b5d3102078f tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Adding security group 5e2b31de-b841-4b95-ba90-d36a9688578b to port 818b1333-97cf-4dc6-b490-98d025379610 Jul 19 15:55:06.000305 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-d46d78d5-5e31-42e6-9b12-6b5d3102078f tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] 10.222.0.64 "POST /compute/v2.1/servers/6a682004-8d98-4d3d-ad12-a1cf82bbaf1e/action" status: 202 len: 0 microversion: 2.1 time: 0.509272 Jul 19 15:55:06.001793 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 519/1089] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Jul 19 15:55:05 2022] POST /compute/v2.1/servers/6a682004-8d98-4d3d-ad12-a1cf82bbaf1e/action => generated 0 bytes in 512 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 15:55:06.011050 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-866fd4f5-5ce8-4047-a74e-05b0defbe0fd tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:06.011751 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-866fd4f5-5ce8-4047-a74e-05b0defbe0fd tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] [instance: 6a682004-8d98-4d3d-ad12-a1cf82bbaf1e] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:06.014801 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG dbcounter [-] [129520] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=3 {{(pid=129520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:55:06.018647 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [req-d91aaebd-8dbc-4619-85d6-617d343b76f1 req-ef6bdcee-3b6d-4a98-9b2a-537c18a4b6e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a682004-8d98-4d3d-ad12-a1cf82bbaf1e", "tag": "818b1333-97cf-4dc6-b490-98d025379610"}]} {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:55:06.022508 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-866fd4f5-5ce8-4047-a74e-05b0defbe0fd tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:06.022959 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-866fd4f5-5ce8-4047-a74e-05b0defbe0fd tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:06.023923 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-866fd4f5-5ce8-4047-a74e-05b0defbe0fd tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:06.024537 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-866fd4f5-5ce8-4047-a74e-05b0defbe0fd tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:06.043069 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [req-d91aaebd-8dbc-4619-85d6-617d343b76f1 req-ef6bdcee-3b6d-4a98-9b2a-537c18a4b6e7 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:06.043528 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [req-d91aaebd-8dbc-4619-85d6-617d343b76f1 req-ef6bdcee-3b6d-4a98-9b2a-537c18a4b6e7 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:06.055851 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG dbcounter [-] [129520] Writing DB stats nova_cell1:SELECT=70,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=129520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:55:06.059669 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.compute.server_external_events [req-d91aaebd-8dbc-4619-85d6-617d343b76f1 req-ef6bdcee-3b6d-4a98-9b2a-537c18a4b6e7 service nova] Creating event network-changed:818b1333-97cf-4dc6-b490-98d025379610 for instance 6a682004-8d98-4d3d-ad12-a1cf82bbaf1e on hv-cinder-84902 Jul 19 15:55:06.067717 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [req-d91aaebd-8dbc-4619-85d6-617d343b76f1 req-ef6bdcee-3b6d-4a98-9b2a-537c18a4b6e7 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056484 Jul 19 15:55:06.068654 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 520/1090] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Jul 19 15:55:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:55:06.210465 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-866fd4f5-5ce8-4047-a74e-05b0defbe0fd tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a63627dc4624d9c8b73bcbfcc11fbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9e5f3b931d47b6bfb7938a89c2a37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:55:06.220682 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-866fd4f5-5ce8-4047-a74e-05b0defbe0fd tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] 10.222.0.64 "GET /compute/v2.1/servers/6a682004-8d98-4d3d-ad12-a1cf82bbaf1e" status: 200 len: 1759 microversion: 2.1 time: 0.213915 Jul 19 15:55:06.222083 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 571/1091] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:55:06 2022] GET /compute/v2.1/servers/6a682004-8d98-4d3d-ad12-a1cf82bbaf1e => generated 1759 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:55:28.922152 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-6a17d34d-82ff-4129-a1eb-9ee6d870c864 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:55:28.923172 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-6a17d34d-82ff-4129-a1eb-9ee6d870c864 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] [instance: 6a682004-8d98-4d3d-ad12-a1cf82bbaf1e] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:28.925684 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG dbcounter [-] [129519] Writing DB stats nova_api:SELECT=3 {{(pid=129519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:55:28.926329 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG dbcounter [-] [129519] Writing DB stats nova_cell1:SELECT=5 {{(pid=129519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:55:28.933407 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-6a17d34d-82ff-4129-a1eb-9ee6d870c864 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:28.933852 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-6a17d34d-82ff-4129-a1eb-9ee6d870c864 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:28.934646 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-6a17d34d-82ff-4129-a1eb-9ee6d870c864 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:28.935085 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-6a17d34d-82ff-4129-a1eb-9ee6d870c864 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:29.009615 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-6a17d34d-82ff-4129-a1eb-9ee6d870c864 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] 10.222.0.64 "POST /compute/v2.1/servers/6a682004-8d98-4d3d-ad12-a1cf82bbaf1e/action" status: 202 len: 0 microversion: 2.1 time: 0.091861 Jul 19 15:55:29.013298 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 521/1092] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Jul 19 15:55:28 2022] POST /compute/v2.1/servers/6a682004-8d98-4d3d-ad12-a1cf82bbaf1e/action => generated 0 bytes in 94 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 15:55:29.018535 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-a7346bd5-fa6d-4199-9f1d-5fcaad4c4596 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:29.019149 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-a7346bd5-fa6d-4199-9f1d-5fcaad4c4596 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] [instance: 6a682004-8d98-4d3d-ad12-a1cf82bbaf1e] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:29.023054 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG dbcounter [-] [129520] Writing DB stats nova_api:SELECT=1 {{(pid=129520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:55:29.023838 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG dbcounter [-] [129520] Writing DB stats nova_cell1:SELECT=5 {{(pid=129520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:55:29.028240 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-a7346bd5-fa6d-4199-9f1d-5fcaad4c4596 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:29.028681 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-a7346bd5-fa6d-4199-9f1d-5fcaad4c4596 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:29.029482 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-a7346bd5-fa6d-4199-9f1d-5fcaad4c4596 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:29.030012 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-a7346bd5-fa6d-4199-9f1d-5fcaad4c4596 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:29.174427 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-a7346bd5-fa6d-4199-9f1d-5fcaad4c4596 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a63627dc4624d9c8b73bcbfcc11fbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9e5f3b931d47b6bfb7938a89c2a37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:55:29.182871 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-a7346bd5-fa6d-4199-9f1d-5fcaad4c4596 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] 10.222.0.64 "GET /compute/v2.1/servers/6a682004-8d98-4d3d-ad12-a1cf82bbaf1e" status: 200 len: 1751 microversion: 2.1 time: 0.168200 Jul 19 15:55:29.183473 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 572/1093] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:55:29 2022] GET /compute/v2.1/servers/6a682004-8d98-4d3d-ad12-a1cf82bbaf1e => generated 1751 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:55:30.201474 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-253f2ab6-02e5-42c3-bd49-d64cd11eebb2 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:30.202210 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-253f2ab6-02e5-42c3-bd49-d64cd11eebb2 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] [instance: 6a682004-8d98-4d3d-ad12-a1cf82bbaf1e] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:30.208482 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-253f2ab6-02e5-42c3-bd49-d64cd11eebb2 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:30.209065 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-253f2ab6-02e5-42c3-bd49-d64cd11eebb2 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:30.209818 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-253f2ab6-02e5-42c3-bd49-d64cd11eebb2 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:30.210274 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-253f2ab6-02e5-42c3-bd49-d64cd11eebb2 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:30.358836 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-253f2ab6-02e5-42c3-bd49-d64cd11eebb2 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a63627dc4624d9c8b73bcbfcc11fbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9e5f3b931d47b6bfb7938a89c2a37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:55:30.369212 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-253f2ab6-02e5-42c3-bd49-d64cd11eebb2 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] 10.222.0.64 "GET /compute/v2.1/servers/6a682004-8d98-4d3d-ad12-a1cf82bbaf1e" status: 200 len: 1756 microversion: 2.1 time: 0.172440 Jul 19 15:55:30.369779 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 522/1094] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:55:30 2022] GET /compute/v2.1/servers/6a682004-8d98-4d3d-ad12-a1cf82bbaf1e => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:55:31.386885 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-6d36baa4-95ec-4229-83a6-c58852a272a0 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:31.387494 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-6d36baa4-95ec-4229-83a6-c58852a272a0 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] [instance: 6a682004-8d98-4d3d-ad12-a1cf82bbaf1e] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:31.394016 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-6d36baa4-95ec-4229-83a6-c58852a272a0 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:31.394498 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-6d36baa4-95ec-4229-83a6-c58852a272a0 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:31.395264 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-6d36baa4-95ec-4229-83a6-c58852a272a0 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:31.395704 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-6d36baa4-95ec-4229-83a6-c58852a272a0 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:31.544704 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-6d36baa4-95ec-4229-83a6-c58852a272a0 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a63627dc4624d9c8b73bcbfcc11fbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9e5f3b931d47b6bfb7938a89c2a37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:55:31.552667 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-6d36baa4-95ec-4229-83a6-c58852a272a0 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] 10.222.0.64 "GET /compute/v2.1/servers/6a682004-8d98-4d3d-ad12-a1cf82bbaf1e" status: 200 len: 1756 microversion: 2.1 time: 0.169661 Jul 19 15:55:31.553229 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 573/1095] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:55:31 2022] GET /compute/v2.1/servers/6a682004-8d98-4d3d-ad12-a1cf82bbaf1e => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:55:32.569756 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-d844c6d2-04f7-48aa-8c75-26c2c58c9ef6 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:32.570405 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-d844c6d2-04f7-48aa-8c75-26c2c58c9ef6 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] [instance: 6a682004-8d98-4d3d-ad12-a1cf82bbaf1e] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:32.576893 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-d844c6d2-04f7-48aa-8c75-26c2c58c9ef6 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:32.577434 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-d844c6d2-04f7-48aa-8c75-26c2c58c9ef6 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:32.578216 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-d844c6d2-04f7-48aa-8c75-26c2c58c9ef6 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:32.578671 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-d844c6d2-04f7-48aa-8c75-26c2c58c9ef6 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:32.720314 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-d844c6d2-04f7-48aa-8c75-26c2c58c9ef6 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a63627dc4624d9c8b73bcbfcc11fbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9e5f3b931d47b6bfb7938a89c2a37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:55:32.728892 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-d844c6d2-04f7-48aa-8c75-26c2c58c9ef6 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] 10.222.0.64 "GET /compute/v2.1/servers/6a682004-8d98-4d3d-ad12-a1cf82bbaf1e" status: 200 len: 1756 microversion: 2.1 time: 0.163723 Jul 19 15:55:32.729447 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 523/1096] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:55:32 2022] GET /compute/v2.1/servers/6a682004-8d98-4d3d-ad12-a1cf82bbaf1e => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:55:33.745823 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-2da660eb-9afc-4e43-bdd7-84f5f612b3dc tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:33.746457 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-2da660eb-9afc-4e43-bdd7-84f5f612b3dc tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] [instance: 6a682004-8d98-4d3d-ad12-a1cf82bbaf1e] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:33.752928 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-2da660eb-9afc-4e43-bdd7-84f5f612b3dc tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:33.753378 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-2da660eb-9afc-4e43-bdd7-84f5f612b3dc tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:33.754137 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-2da660eb-9afc-4e43-bdd7-84f5f612b3dc tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:33.754597 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-2da660eb-9afc-4e43-bdd7-84f5f612b3dc tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:33.832396 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-a5f1cd4a-4798-47a6-afdd-095e4e91332b tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:33.832925 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-a5f1cd4a-4798-47a6-afdd-095e4e91332b tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] [instance: 4a9ac02c-69eb-45b4-8380-42ab80044abe] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:33.839683 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-a5f1cd4a-4798-47a6-afdd-095e4e91332b tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:33.840134 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-a5f1cd4a-4798-47a6-afdd-095e4e91332b tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:33.840899 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-a5f1cd4a-4798-47a6-afdd-095e4e91332b tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:33.841649 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-a5f1cd4a-4798-47a6-afdd-095e4e91332b tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:33.867680 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-a5f1cd4a-4798-47a6-afdd-095e4e91332b tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] [instance: 4a9ac02c-69eb-45b4-8380-42ab80044abe] Going to try to terminate instance {{(pid=129519) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 15:55:33.913995 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-2da660eb-9afc-4e43-bdd7-84f5f612b3dc tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a63627dc4624d9c8b73bcbfcc11fbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9e5f3b931d47b6bfb7938a89c2a37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:55:33.923354 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-2da660eb-9afc-4e43-bdd7-84f5f612b3dc tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] 10.222.0.64 "GET /compute/v2.1/servers/6a682004-8d98-4d3d-ad12-a1cf82bbaf1e" status: 200 len: 1756 microversion: 2.1 time: 0.181157 Jul 19 15:55:33.934274 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 574/1097] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:55:33 2022] GET /compute/v2.1/servers/6a682004-8d98-4d3d-ad12-a1cf82bbaf1e => generated 1756 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:55:33.939559 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [req-f1cac962-9f5c-4463-a000-18671e333dbb req-5065d54a-3eb4-441a-8d19-6361c4bc9e4f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a9ac02c-69eb-45b4-8380-42ab80044abe", "tag": "1c5f2b65-7e32-469b-be88-24a29ea25fa7"}]} {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:55:33.949224 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [req-f1cac962-9f5c-4463-a000-18671e333dbb req-5065d54a-3eb4-441a-8d19-6361c4bc9e4f service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:33.949808 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [req-f1cac962-9f5c-4463-a000-18671e333dbb req-5065d54a-3eb4-441a-8d19-6361c4bc9e4f service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:33.962396 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-a5f1cd4a-4798-47a6-afdd-095e4e91332b tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] 10.222.0.64 "DELETE /compute/v2.1/servers/4a9ac02c-69eb-45b4-8380-42ab80044abe" status: 204 len: 0 microversion: 2.1 time: 0.133428 Jul 19 15:55:33.963415 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 524/1098] 10.222.0.64 () {58 vars in 1238 bytes} [Tue Jul 19 15:55:33 2022] DELETE /compute/v2.1/servers/4a9ac02c-69eb-45b4-8380-42ab80044abe => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 15:55:33.972908 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.compute.server_external_events [req-f1cac962-9f5c-4463-a000-18671e333dbb req-5065d54a-3eb4-441a-8d19-6361c4bc9e4f service nova] Creating event network-changed:1c5f2b65-7e32-469b-be88-24a29ea25fa7 for instance 4a9ac02c-69eb-45b4-8380-42ab80044abe on hv-cinder-84902 Jul 19 15:55:33.973524 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-a9c7521d-f132-4606-9d4e-e5c4b7c94886 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:33.974880 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-a9c7521d-f132-4606-9d4e-e5c4b7c94886 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] [instance: 4a9ac02c-69eb-45b4-8380-42ab80044abe] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:33.981519 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-a9c7521d-f132-4606-9d4e-e5c4b7c94886 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:33.982055 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-a9c7521d-f132-4606-9d4e-e5c4b7c94886 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:33.982323 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [req-f1cac962-9f5c-4463-a000-18671e333dbb req-5065d54a-3eb4-441a-8d19-6361c4bc9e4f service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045879 Jul 19 15:55:33.983001 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-a9c7521d-f132-4606-9d4e-e5c4b7c94886 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:33.983517 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-a9c7521d-f132-4606-9d4e-e5c4b7c94886 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:33.983920 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 575/1099] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Jul 19 15:55:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:55:34.123192 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-a9c7521d-f132-4606-9d4e-e5c4b7c94886 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae334c4d93cd4d3e94789a5985fcfa77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6827afcdf1f3481882f808dc01908a4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:55:34.131408 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-a9c7521d-f132-4606-9d4e-e5c4b7c94886 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] 10.222.0.64 "GET /compute/v2.1/servers/4a9ac02c-69eb-45b4-8380-42ab80044abe" status: 200 len: 1577 microversion: 2.1 time: 0.162258 Jul 19 15:55:34.132345 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 525/1100] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:55:33 2022] GET /compute/v2.1/servers/4a9ac02c-69eb-45b4-8380-42ab80044abe => generated 1577 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:55:34.942322 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-62560262-88b5-493d-bcc9-f1af01a3e644 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:34.943600 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-62560262-88b5-493d-bcc9-f1af01a3e644 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] [instance: 6a682004-8d98-4d3d-ad12-a1cf82bbaf1e] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:34.949920 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-62560262-88b5-493d-bcc9-f1af01a3e644 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:34.950411 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-62560262-88b5-493d-bcc9-f1af01a3e644 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:34.951184 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-62560262-88b5-493d-bcc9-f1af01a3e644 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:34.951613 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-62560262-88b5-493d-bcc9-f1af01a3e644 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:35.095925 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-62560262-88b5-493d-bcc9-f1af01a3e644 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a63627dc4624d9c8b73bcbfcc11fbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9e5f3b931d47b6bfb7938a89c2a37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:55:35.104211 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-62560262-88b5-493d-bcc9-f1af01a3e644 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] 10.222.0.64 "GET /compute/v2.1/servers/6a682004-8d98-4d3d-ad12-a1cf82bbaf1e" status: 200 len: 1756 microversion: 2.1 time: 0.166749 Jul 19 15:55:35.104773 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 576/1101] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:55:34 2022] GET /compute/v2.1/servers/6a682004-8d98-4d3d-ad12-a1cf82bbaf1e => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:55:35.149715 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-b59ae474-c6ff-4872-ab77-77428c46754b tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:35.150450 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-b59ae474-c6ff-4872-ab77-77428c46754b tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] [instance: 4a9ac02c-69eb-45b4-8380-42ab80044abe] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:35.156573 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-b59ae474-c6ff-4872-ab77-77428c46754b tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:35.157018 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-b59ae474-c6ff-4872-ab77-77428c46754b tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:35.157773 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-b59ae474-c6ff-4872-ab77-77428c46754b tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:35.158208 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-b59ae474-c6ff-4872-ab77-77428c46754b tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:35.300232 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-b59ae474-c6ff-4872-ab77-77428c46754b tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae334c4d93cd4d3e94789a5985fcfa77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6827afcdf1f3481882f808dc01908a4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:55:35.308358 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-b59ae474-c6ff-4872-ab77-77428c46754b tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] 10.222.0.64 "GET /compute/v2.1/servers/4a9ac02c-69eb-45b4-8380-42ab80044abe" status: 200 len: 1577 microversion: 2.1 time: 0.162514 Jul 19 15:55:35.308910 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 526/1102] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:55:35 2022] GET /compute/v2.1/servers/4a9ac02c-69eb-45b4-8380-42ab80044abe => generated 1577 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:55:35.976625 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [req-4a01fb1b-8e38-42fe-ad91-bd18f75eca60 req-223a02ec-9348-4817-b413-988fa6069ed1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a9ac02c-69eb-45b4-8380-42ab80044abe", "name": "network-vif-deleted", "tag": "1c5f2b65-7e32-469b-be88-24a29ea25fa7"}]} {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:55:35.985582 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [req-4a01fb1b-8e38-42fe-ad91-bd18f75eca60 req-223a02ec-9348-4817-b413-988fa6069ed1 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:35.986024 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [req-4a01fb1b-8e38-42fe-ad91-bd18f75eca60 req-223a02ec-9348-4817-b413-988fa6069ed1 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:36.008042 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.compute.server_external_events [req-4a01fb1b-8e38-42fe-ad91-bd18f75eca60 req-223a02ec-9348-4817-b413-988fa6069ed1 service nova] Creating event network-vif-deleted:1c5f2b65-7e32-469b-be88-24a29ea25fa7 for instance 4a9ac02c-69eb-45b4-8380-42ab80044abe on hv-cinder-84902 Jul 19 15:55:36.013002 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [req-4a01fb1b-8e38-42fe-ad91-bd18f75eca60 req-223a02ec-9348-4817-b413-988fa6069ed1 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041015 Jul 19 15:55:36.013608 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 577/1103] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Jul 19 15:55:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:55:36.120974 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-2142cc5b-fee0-41d5-9805-0b5e48c45f6e tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:36.121578 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-2142cc5b-fee0-41d5-9805-0b5e48c45f6e tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] [instance: 6a682004-8d98-4d3d-ad12-a1cf82bbaf1e] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:36.127620 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-2142cc5b-fee0-41d5-9805-0b5e48c45f6e tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:36.128076 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-2142cc5b-fee0-41d5-9805-0b5e48c45f6e tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:36.128831 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-2142cc5b-fee0-41d5-9805-0b5e48c45f6e tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:36.129269 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-2142cc5b-fee0-41d5-9805-0b5e48c45f6e tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:36.280958 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-2142cc5b-fee0-41d5-9805-0b5e48c45f6e tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a63627dc4624d9c8b73bcbfcc11fbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9e5f3b931d47b6bfb7938a89c2a37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:55:36.289693 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-2142cc5b-fee0-41d5-9805-0b5e48c45f6e tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] 10.222.0.64 "GET /compute/v2.1/servers/6a682004-8d98-4d3d-ad12-a1cf82bbaf1e" status: 200 len: 1756 microversion: 2.1 time: 0.172462 Jul 19 15:55:36.290545 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 527/1104] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:55:36 2022] GET /compute/v2.1/servers/6a682004-8d98-4d3d-ad12-a1cf82bbaf1e => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:55:36.328445 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-e32a555b-248d-41ae-9835-d7a32faa0ca6 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:36.329324 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-e32a555b-248d-41ae-9835-d7a32faa0ca6 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] [instance: 4a9ac02c-69eb-45b4-8380-42ab80044abe] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:36.336976 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-e32a555b-248d-41ae-9835-d7a32faa0ca6 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:36.337420 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-e32a555b-248d-41ae-9835-d7a32faa0ca6 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:36.338342 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-e32a555b-248d-41ae-9835-d7a32faa0ca6 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:36.339148 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-e32a555b-248d-41ae-9835-d7a32faa0ca6 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:36.371599 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-e32a555b-248d-41ae-9835-d7a32faa0ca6 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:36.372043 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-e32a555b-248d-41ae-9835-d7a32faa0ca6 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:36.372487 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.objects.instance [None req-e32a555b-248d-41ae-9835-d7a32faa0ca6 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lazy-loading 'fault' on Instance uuid 4a9ac02c-69eb-45b4-8380-42ab80044abe {{(pid=129520) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 15:55:36.420567 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-e32a555b-248d-41ae-9835-d7a32faa0ca6 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae334c4d93cd4d3e94789a5985fcfa77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6827afcdf1f3481882f808dc01908a4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:55:36.429001 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-e32a555b-248d-41ae-9835-d7a32faa0ca6 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] 10.222.0.64 "GET /compute/v2.1/servers/4a9ac02c-69eb-45b4-8380-42ab80044abe" status: 200 len: 1230 microversion: 2.1 time: 0.105685 Jul 19 15:55:36.429561 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 578/1105] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:55:36 2022] GET /compute/v2.1/servers/4a9ac02c-69eb-45b4-8380-42ab80044abe => generated 1230 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:55:37.307755 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-de3a8e09-a6fd-4eb1-a1e8-9b2775b13253 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:37.308400 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-de3a8e09-a6fd-4eb1-a1e8-9b2775b13253 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] [instance: 6a682004-8d98-4d3d-ad12-a1cf82bbaf1e] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:37.314914 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-de3a8e09-a6fd-4eb1-a1e8-9b2775b13253 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:37.315370 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-de3a8e09-a6fd-4eb1-a1e8-9b2775b13253 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:37.316133 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-de3a8e09-a6fd-4eb1-a1e8-9b2775b13253 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:37.316574 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-de3a8e09-a6fd-4eb1-a1e8-9b2775b13253 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:37.445938 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-def5f638-c093-4269-a971-aac61170695b tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:37.446683 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-def5f638-c093-4269-a971-aac61170695b tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] [instance: 4a9ac02c-69eb-45b4-8380-42ab80044abe] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:37.453185 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-def5f638-c093-4269-a971-aac61170695b tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:37.453633 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-def5f638-c093-4269-a971-aac61170695b tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:37.454419 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-def5f638-c093-4269-a971-aac61170695b tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:37.454863 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-def5f638-c093-4269-a971-aac61170695b tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:37.463302 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-de3a8e09-a6fd-4eb1-a1e8-9b2775b13253 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a63627dc4624d9c8b73bcbfcc11fbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9e5f3b931d47b6bfb7938a89c2a37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:55:37.469481 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.wsgi [None req-def5f638-c093-4269-a971-aac61170695b tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] HTTP exception thrown: Instance 4a9ac02c-69eb-45b4-8380-42ab80044abe could not be found. Jul 19 15:55:37.471196 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-de3a8e09-a6fd-4eb1-a1e8-9b2775b13253 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] 10.222.0.64 "GET /compute/v2.1/servers/6a682004-8d98-4d3d-ad12-a1cf82bbaf1e" status: 200 len: 1756 microversion: 2.1 time: 0.167318 Jul 19 15:55:37.471338 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-def5f638-c093-4269-a971-aac61170695b tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Request method failure captured: Jul 19 15:55:37.471338 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: request: GET /compute/v2.1/servers/4a9ac02c-69eb-45b4-8380-42ab80044abe HTTP/1.1 Jul 19 15:55:37.471338 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Accept: application/json Jul 19 15:55:37.471338 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Accept-Encoding: identity Jul 19 15:55:37.471338 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Connection: close Jul 19 15:55:37.471338 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Content-Length: 0 Jul 19 15:55:37.471338 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Content-Type: application/json Jul 19 15:55:37.471338 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Host: 10.222.0.64 Jul 19 15:55:37.471338 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Openstack-System-Scope: None Jul 19 15:55:37.471338 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: User-Agent: python-urllib3/1.26.9 Jul 19 15:55:37.471338 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Auth-Token: gAAAAABi1tIKmGNKjwQgkw9F_DlegiMzZqtLsl76NPyy0vJQFYgomcM9bzzZELZ_B5F1MJo9XaGabhaizyJFkZqqGK3-DLol0-LA7zgantfqN4gEYaL9Hb74O0C0Egru9kBMuLlaahTktA4ieEsVNRriI3odZ_vPLqGBzvwdDfERnmH70nsEmR0 Jul 19 15:55:37.471338 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Domain-Id: None Jul 19 15:55:37.471338 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Domain-Name: None Jul 19 15:55:37.471338 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Identity-Status: Confirmed Jul 19 15:55:37.471338 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Is-Admin-Project: True Jul 19 15:55:37.471338 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Project-Domain-Id: default Jul 19 15:55:37.471338 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Project-Domain-Name: Default Jul 19 15:55:37.471338 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Project-Id: 6827afcdf1f3481882f808dc01908a4d Jul 19 15:55:37.471338 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Project-Name: tempest-TestVolumeBootPattern-1663767670 Jul 19 15:55:37.471338 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Role: member,reader Jul 19 15:55:37.471338 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Roles: member,reader Jul 19 15:55:37.473035 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_6827afcdf1f3481882f808dc01908a4d", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6827afcdf1f3481882f808dc01908a4d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6827afcdf1f3481882f808dc01908a4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/6827afcdf1f3481882f808dc01908a4d"}]}] Jul 19 15:55:37.473035 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Tenant: tempest-TestVolumeBootPattern-1663767670 Jul 19 15:55:37.473035 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Tenant-Id: 6827afcdf1f3481882f808dc01908a4d Jul 19 15:55:37.473035 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Tenant-Name: tempest-TestVolumeBootPattern-1663767670 Jul 19 15:55:37.473035 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User: tempest-TestVolumeBootPattern-1663767670-project Jul 19 15:55:37.473035 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User-Domain-Id: default Jul 19 15:55:37.473035 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User-Domain-Name: Default Jul 19 15:55:37.473035 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User-Id: ae334c4d93cd4d3e94789a5985fcfa77 Jul 19 15:55:37.473035 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User-Name: tempest-TestVolumeBootPattern-1663767670-project Jul 19 15:55:37.473035 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: method: > Jul 19 15:55:37.473035 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: exception: Instance 4a9ac02c-69eb-45b4-8380-42ab80044abe could not be found. Jul 19 15:55:37.473035 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: action_args: {'id': '4a9ac02c-69eb-45b4-8380-42ab80044abe'} Jul 19 15:55:37.474873 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:55:37.474873 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:55:37.474873 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 15:55:37.474873 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 15:55:37.474873 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 15:55:37.474873 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 15:55:37.474873 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 15:55:37.474873 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 15:55:37.474873 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 15:55:37.474873 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 15:55:37.474873 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4a9ac02c-69eb-45b4-8380-42ab80044abe could not be found. Jul 19 15:55:37.474873 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:55:37.474873 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:55:37.474873 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:55:37.474873 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:55:37.474873 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:55:37.474873 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:55:37.474873 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:55:37.474873 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:55:37.474873 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:55:37.476472 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:55:37.476472 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 15:55:37.476472 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 15:55:37.476472 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 15:55:37.476472 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 15:55:37.476472 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 15:55:37.476472 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 15:55:37.476472 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4a9ac02c-69eb-45b4-8380-42ab80044abe could not be found. Jul 19 15:55:37.476472 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:55:37.476472 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:55:37.476472 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:55:37.476472 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:55:37.476472 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:55:37.476472 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:55:37.476472 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:55:37.476472 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:55:37.476472 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4a9ac02c-69eb-45b4-8380-42ab80044abe could not be found. Jul 19 15:55:37.476472 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:55:37.478665 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 528/1106] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:55:37 2022] GET /compute/v2.1/servers/6a682004-8d98-4d3d-ad12-a1cf82bbaf1e => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:55:37.478775 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-def5f638-c093-4269-a971-aac61170695b tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Returning 404 to user: Instance 4a9ac02c-69eb-45b4-8380-42ab80044abe could not be found. {{(pid=129520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:55:37.478775 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-def5f638-c093-4269-a971-aac61170695b tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] 10.222.0.64 "GET /compute/v2.1/servers/4a9ac02c-69eb-45b4-8380-42ab80044abe" status: 404 len: 111 microversion: 2.1 time: 0.033650 Jul 19 15:55:37.478775 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 579/1107] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:55:37 2022] GET /compute/v2.1/servers/4a9ac02c-69eb-45b4-8380-42ab80044abe => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 15:55:38.488964 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-b4e9a6bf-d70b-4e01-a1d5-8a1a819bd338 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:38.489585 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-b4e9a6bf-d70b-4e01-a1d5-8a1a819bd338 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] [instance: 6a682004-8d98-4d3d-ad12-a1cf82bbaf1e] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:38.496118 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-b4e9a6bf-d70b-4e01-a1d5-8a1a819bd338 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:38.496560 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-b4e9a6bf-d70b-4e01-a1d5-8a1a819bd338 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:38.497344 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-b4e9a6bf-d70b-4e01-a1d5-8a1a819bd338 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:38.497776 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-b4e9a6bf-d70b-4e01-a1d5-8a1a819bd338 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:38.640598 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-b4e9a6bf-d70b-4e01-a1d5-8a1a819bd338 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a63627dc4624d9c8b73bcbfcc11fbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9e5f3b931d47b6bfb7938a89c2a37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:55:38.649027 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-b4e9a6bf-d70b-4e01-a1d5-8a1a819bd338 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] 10.222.0.64 "GET /compute/v2.1/servers/6a682004-8d98-4d3d-ad12-a1cf82bbaf1e" status: 200 len: 1756 microversion: 2.1 time: 0.163902 Jul 19 15:55:38.649578 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 529/1108] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:55:38 2022] GET /compute/v2.1/servers/6a682004-8d98-4d3d-ad12-a1cf82bbaf1e => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:55:39.666775 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-9cb4c573-463b-4d7e-9f08-ce784042b676 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:39.667374 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-9cb4c573-463b-4d7e-9f08-ce784042b676 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] [instance: 6a682004-8d98-4d3d-ad12-a1cf82bbaf1e] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:39.674290 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-9cb4c573-463b-4d7e-9f08-ce784042b676 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:39.674762 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-9cb4c573-463b-4d7e-9f08-ce784042b676 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:39.675515 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-9cb4c573-463b-4d7e-9f08-ce784042b676 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:39.675940 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-9cb4c573-463b-4d7e-9f08-ce784042b676 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:39.825639 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-9cb4c573-463b-4d7e-9f08-ce784042b676 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a63627dc4624d9c8b73bcbfcc11fbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9e5f3b931d47b6bfb7938a89c2a37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:55:39.833779 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-9cb4c573-463b-4d7e-9f08-ce784042b676 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] 10.222.0.64 "GET /compute/v2.1/servers/6a682004-8d98-4d3d-ad12-a1cf82bbaf1e" status: 200 len: 1756 microversion: 2.1 time: 0.170834 Jul 19 15:55:39.834500 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 580/1109] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:55:39 2022] GET /compute/v2.1/servers/6a682004-8d98-4d3d-ad12-a1cf82bbaf1e => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:55:40.533042 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-d265bbd1-7613-4de5-8cd9-ad60de093776 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:40.533547 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-d265bbd1-7613-4de5-8cd9-ad60de093776 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] [instance: d978b05a-906b-47db-8f20-9a7daaaf67f1] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:40.539064 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [req-c3013a17-07de-4b8f-bfa1-ff1d86d75f7e req-f77edfa5-5f26-4eb7-b6a1-a4bbdb5ea6c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d978b05a-906b-47db-8f20-9a7daaaf67f1", "tag": "b12bd5cf-7ec9-4e31-91c4-9d3a0b5e7d26"}]} {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:55:40.550581 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-d265bbd1-7613-4de5-8cd9-ad60de093776 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:40.551004 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-d265bbd1-7613-4de5-8cd9-ad60de093776 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:40.551481 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [req-c3013a17-07de-4b8f-bfa1-ff1d86d75f7e req-f77edfa5-5f26-4eb7-b6a1-a4bbdb5ea6c9 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:40.551841 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-d265bbd1-7613-4de5-8cd9-ad60de093776 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:40.552084 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [req-c3013a17-07de-4b8f-bfa1-ff1d86d75f7e req-f77edfa5-5f26-4eb7-b6a1-a4bbdb5ea6c9 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:40.552782 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-d265bbd1-7613-4de5-8cd9-ad60de093776 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:40.570902 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.compute.server_external_events [req-c3013a17-07de-4b8f-bfa1-ff1d86d75f7e req-f77edfa5-5f26-4eb7-b6a1-a4bbdb5ea6c9 service nova] Creating event network-changed:b12bd5cf-7ec9-4e31-91c4-9d3a0b5e7d26 for instance d978b05a-906b-47db-8f20-9a7daaaf67f1 on hv-cinder-84902 Jul 19 15:55:40.577320 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [req-c3013a17-07de-4b8f-bfa1-ff1d86d75f7e req-f77edfa5-5f26-4eb7-b6a1-a4bbdb5ea6c9 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042124 Jul 19 15:55:40.578141 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 581/1110] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Jul 19 15:55:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:55:40.582151 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-d265bbd1-7613-4de5-8cd9-ad60de093776 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] [instance: d978b05a-906b-47db-8f20-9a7daaaf67f1] Going to try to terminate instance {{(pid=129519) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 15:55:40.669964 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-d265bbd1-7613-4de5-8cd9-ad60de093776 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] 10.222.0.64 "DELETE /compute/v2.1/servers/d978b05a-906b-47db-8f20-9a7daaaf67f1" status: 204 len: 0 microversion: 2.1 time: 0.140169 Jul 19 15:55:40.671340 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 530/1111] 10.222.0.64 () {58 vars in 1238 bytes} [Tue Jul 19 15:55:40 2022] DELETE /compute/v2.1/servers/d978b05a-906b-47db-8f20-9a7daaaf67f1 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 15:55:40.680508 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-b1d7d72c-1232-4b4b-a61c-f5ef19a473ae tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:40.681226 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-b1d7d72c-1232-4b4b-a61c-f5ef19a473ae tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] [instance: d978b05a-906b-47db-8f20-9a7daaaf67f1] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:40.694437 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b1d7d72c-1232-4b4b-a61c-f5ef19a473ae tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:40.694983 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b1d7d72c-1232-4b4b-a61c-f5ef19a473ae tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:40.695845 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b1d7d72c-1232-4b4b-a61c-f5ef19a473ae tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:40.696350 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-b1d7d72c-1232-4b4b-a61c-f5ef19a473ae tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:40.852243 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-56698b36-95e9-4b54-bd41-5a02a5288b5f tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:40.853100 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-56698b36-95e9-4b54-bd41-5a02a5288b5f tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] [instance: 6a682004-8d98-4d3d-ad12-a1cf82bbaf1e] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:40.858936 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-b1d7d72c-1232-4b4b-a61c-f5ef19a473ae tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae334c4d93cd4d3e94789a5985fcfa77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6827afcdf1f3481882f808dc01908a4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:55:40.861993 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-56698b36-95e9-4b54-bd41-5a02a5288b5f tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:40.862495 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-56698b36-95e9-4b54-bd41-5a02a5288b5f tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:40.863275 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-56698b36-95e9-4b54-bd41-5a02a5288b5f tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:40.863706 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-56698b36-95e9-4b54-bd41-5a02a5288b5f tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:40.868109 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-b1d7d72c-1232-4b4b-a61c-f5ef19a473ae tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] 10.222.0.64 "GET /compute/v2.1/servers/d978b05a-906b-47db-8f20-9a7daaaf67f1" status: 200 len: 1576 microversion: 2.1 time: 0.192526 Jul 19 15:55:40.868816 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 582/1112] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:55:40 2022] GET /compute/v2.1/servers/d978b05a-906b-47db-8f20-9a7daaaf67f1 => generated 1576 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:55:41.126298 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-56698b36-95e9-4b54-bd41-5a02a5288b5f tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a63627dc4624d9c8b73bcbfcc11fbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9e5f3b931d47b6bfb7938a89c2a37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:55:41.134749 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-56698b36-95e9-4b54-bd41-5a02a5288b5f tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] 10.222.0.64 "GET /compute/v2.1/servers/6a682004-8d98-4d3d-ad12-a1cf82bbaf1e" status: 200 len: 1756 microversion: 2.1 time: 0.287082 Jul 19 15:55:41.135330 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 531/1113] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:55:40 2022] GET /compute/v2.1/servers/6a682004-8d98-4d3d-ad12-a1cf82bbaf1e => generated 1756 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:55:41.885634 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-c00cf208-1c84-42c8-9d85-46616075a58e tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:41.886240 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-c00cf208-1c84-42c8-9d85-46616075a58e tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] [instance: d978b05a-906b-47db-8f20-9a7daaaf67f1] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:41.892725 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-c00cf208-1c84-42c8-9d85-46616075a58e tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:41.893168 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-c00cf208-1c84-42c8-9d85-46616075a58e tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:41.893918 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-c00cf208-1c84-42c8-9d85-46616075a58e tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:41.894346 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-c00cf208-1c84-42c8-9d85-46616075a58e tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:42.132311 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-c00cf208-1c84-42c8-9d85-46616075a58e tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae334c4d93cd4d3e94789a5985fcfa77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6827afcdf1f3481882f808dc01908a4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:55:42.139964 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-c00cf208-1c84-42c8-9d85-46616075a58e tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] 10.222.0.64 "GET /compute/v2.1/servers/d978b05a-906b-47db-8f20-9a7daaaf67f1" status: 200 len: 1576 microversion: 2.1 time: 0.258371 Jul 19 15:55:42.140532 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 583/1114] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:55:41 2022] GET /compute/v2.1/servers/d978b05a-906b-47db-8f20-9a7daaaf67f1 => generated 1576 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:55:42.152462 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-7f1406c8-9d84-4f7c-b9a1-2349f0e693ab tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:42.153079 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-7f1406c8-9d84-4f7c-b9a1-2349f0e693ab tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] [instance: 6a682004-8d98-4d3d-ad12-a1cf82bbaf1e] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:42.169973 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-7f1406c8-9d84-4f7c-b9a1-2349f0e693ab tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:42.170458 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-7f1406c8-9d84-4f7c-b9a1-2349f0e693ab tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:42.171260 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-7f1406c8-9d84-4f7c-b9a1-2349f0e693ab tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:42.171706 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-7f1406c8-9d84-4f7c-b9a1-2349f0e693ab tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:42.413969 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-7f1406c8-9d84-4f7c-b9a1-2349f0e693ab tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a63627dc4624d9c8b73bcbfcc11fbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9e5f3b931d47b6bfb7938a89c2a37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:55:42.422545 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-7f1406c8-9d84-4f7c-b9a1-2349f0e693ab tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] 10.222.0.64 "GET /compute/v2.1/servers/6a682004-8d98-4d3d-ad12-a1cf82bbaf1e" status: 200 len: 1756 microversion: 2.1 time: 0.273966 Jul 19 15:55:42.423120 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 532/1115] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:55:42 2022] GET /compute/v2.1/servers/6a682004-8d98-4d3d-ad12-a1cf82bbaf1e => generated 1756 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:55:42.732207 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [req-f2a48fbe-eaa8-4f9a-954f-2236dc40a3ed req-534ecf9b-b8a8-4d8c-9033-489880aa6c36 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d978b05a-906b-47db-8f20-9a7daaaf67f1", "name": "network-vif-deleted", "tag": "b12bd5cf-7ec9-4e31-91c4-9d3a0b5e7d26"}]} {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:55:42.741209 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [req-f2a48fbe-eaa8-4f9a-954f-2236dc40a3ed req-534ecf9b-b8a8-4d8c-9033-489880aa6c36 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:42.741685 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [req-f2a48fbe-eaa8-4f9a-954f-2236dc40a3ed req-534ecf9b-b8a8-4d8c-9033-489880aa6c36 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:42.752796 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.compute.server_external_events [req-f2a48fbe-eaa8-4f9a-954f-2236dc40a3ed req-534ecf9b-b8a8-4d8c-9033-489880aa6c36 service nova] Creating event network-vif-deleted:b12bd5cf-7ec9-4e31-91c4-9d3a0b5e7d26 for instance d978b05a-906b-47db-8f20-9a7daaaf67f1 on hv-cinder-84902 Jul 19 15:55:42.757567 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [req-f2a48fbe-eaa8-4f9a-954f-2236dc40a3ed req-534ecf9b-b8a8-4d8c-9033-489880aa6c36 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029232 Jul 19 15:55:42.758263 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 584/1116] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Jul 19 15:55:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:55:43.158188 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-7cb45590-5691-4e1e-89e7-3989d3db3ace tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:43.158861 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-7cb45590-5691-4e1e-89e7-3989d3db3ace tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] [instance: d978b05a-906b-47db-8f20-9a7daaaf67f1] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:43.165376 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-7cb45590-5691-4e1e-89e7-3989d3db3ace tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:43.165820 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-7cb45590-5691-4e1e-89e7-3989d3db3ace tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:43.166611 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-7cb45590-5691-4e1e-89e7-3989d3db3ace tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:43.167047 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-7cb45590-5691-4e1e-89e7-3989d3db3ace tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:43.171288 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG dbcounter [-] [129519] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=129519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:55:43.199749 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-7cb45590-5691-4e1e-89e7-3989d3db3ace tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:43.200112 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-7cb45590-5691-4e1e-89e7-3989d3db3ace tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:43.200555 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.objects.instance [None req-7cb45590-5691-4e1e-89e7-3989d3db3ace tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lazy-loading 'fault' on Instance uuid d978b05a-906b-47db-8f20-9a7daaaf67f1 {{(pid=129519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 15:55:43.244007 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-7cb45590-5691-4e1e-89e7-3989d3db3ace tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae334c4d93cd4d3e94789a5985fcfa77', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6827afcdf1f3481882f808dc01908a4d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:55:43.251643 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-7cb45590-5691-4e1e-89e7-3989d3db3ace tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] 10.222.0.64 "GET /compute/v2.1/servers/d978b05a-906b-47db-8f20-9a7daaaf67f1" status: 200 len: 1229 microversion: 2.1 time: 0.097263 Jul 19 15:55:43.252135 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 533/1117] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:55:43 2022] GET /compute/v2.1/servers/d978b05a-906b-47db-8f20-9a7daaaf67f1 => generated 1229 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:55:43.440029 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-cac298b3-88b6-4328-b14b-15ec75c7fa58 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:43.440783 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-cac298b3-88b6-4328-b14b-15ec75c7fa58 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] [instance: 6a682004-8d98-4d3d-ad12-a1cf82bbaf1e] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:43.447455 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-cac298b3-88b6-4328-b14b-15ec75c7fa58 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:43.447902 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-cac298b3-88b6-4328-b14b-15ec75c7fa58 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:43.448655 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-cac298b3-88b6-4328-b14b-15ec75c7fa58 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:43.449092 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-cac298b3-88b6-4328-b14b-15ec75c7fa58 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:43.591624 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-cac298b3-88b6-4328-b14b-15ec75c7fa58 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a63627dc4624d9c8b73bcbfcc11fbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9e5f3b931d47b6bfb7938a89c2a37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:55:43.599536 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-cac298b3-88b6-4328-b14b-15ec75c7fa58 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] 10.222.0.64 "GET /compute/v2.1/servers/6a682004-8d98-4d3d-ad12-a1cf82bbaf1e" status: 200 len: 1756 microversion: 2.1 time: 0.164150 Jul 19 15:55:43.600109 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 585/1118] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:55:43 2022] GET /compute/v2.1/servers/6a682004-8d98-4d3d-ad12-a1cf82bbaf1e => generated 1756 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:55:44.269985 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-4a1d690f-3896-4cf9-8b10-5bf08a0f7888 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:44.270571 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-4a1d690f-3896-4cf9-8b10-5bf08a0f7888 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] [instance: d978b05a-906b-47db-8f20-9a7daaaf67f1] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:44.278180 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-4a1d690f-3896-4cf9-8b10-5bf08a0f7888 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:44.278657 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-4a1d690f-3896-4cf9-8b10-5bf08a0f7888 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:44.279408 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-4a1d690f-3896-4cf9-8b10-5bf08a0f7888 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:44.279996 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-4a1d690f-3896-4cf9-8b10-5bf08a0f7888 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:44.294244 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.wsgi [None req-4a1d690f-3896-4cf9-8b10-5bf08a0f7888 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] HTTP exception thrown: Instance d978b05a-906b-47db-8f20-9a7daaaf67f1 could not be found. Jul 19 15:55:44.295892 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-4a1d690f-3896-4cf9-8b10-5bf08a0f7888 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Request method failure captured: Jul 19 15:55:44.295892 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: request: GET /compute/v2.1/servers/d978b05a-906b-47db-8f20-9a7daaaf67f1 HTTP/1.1 Jul 19 15:55:44.295892 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Accept: application/json Jul 19 15:55:44.295892 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Accept-Encoding: identity Jul 19 15:55:44.295892 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Connection: close Jul 19 15:55:44.295892 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Content-Length: 0 Jul 19 15:55:44.295892 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Content-Type: application/json Jul 19 15:55:44.295892 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Host: 10.222.0.64 Jul 19 15:55:44.295892 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Openstack-System-Scope: None Jul 19 15:55:44.295892 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: User-Agent: python-urllib3/1.26.9 Jul 19 15:55:44.295892 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Auth-Token: gAAAAABi1tIKmGNKjwQgkw9F_DlegiMzZqtLsl76NPyy0vJQFYgomcM9bzzZELZ_B5F1MJo9XaGabhaizyJFkZqqGK3-DLol0-LA7zgantfqN4gEYaL9Hb74O0C0Egru9kBMuLlaahTktA4ieEsVNRriI3odZ_vPLqGBzvwdDfERnmH70nsEmR0 Jul 19 15:55:44.295892 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Domain-Id: None Jul 19 15:55:44.295892 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Domain-Name: None Jul 19 15:55:44.295892 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Identity-Status: Confirmed Jul 19 15:55:44.295892 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Is-Admin-Project: True Jul 19 15:55:44.295892 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Domain-Id: default Jul 19 15:55:44.295892 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Domain-Name: Default Jul 19 15:55:44.295892 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Id: 6827afcdf1f3481882f808dc01908a4d Jul 19 15:55:44.295892 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Name: tempest-TestVolumeBootPattern-1663767670 Jul 19 15:55:44.295892 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Role: member,reader Jul 19 15:55:44.295892 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Roles: member,reader Jul 19 15:55:44.297524 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_6827afcdf1f3481882f808dc01908a4d", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6827afcdf1f3481882f808dc01908a4d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6827afcdf1f3481882f808dc01908a4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/6827afcdf1f3481882f808dc01908a4d"}]}] Jul 19 15:55:44.297524 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Tenant: tempest-TestVolumeBootPattern-1663767670 Jul 19 15:55:44.297524 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Tenant-Id: 6827afcdf1f3481882f808dc01908a4d Jul 19 15:55:44.297524 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Tenant-Name: tempest-TestVolumeBootPattern-1663767670 Jul 19 15:55:44.297524 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User: tempest-TestVolumeBootPattern-1663767670-project Jul 19 15:55:44.297524 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Domain-Id: default Jul 19 15:55:44.297524 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Domain-Name: Default Jul 19 15:55:44.297524 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Id: ae334c4d93cd4d3e94789a5985fcfa77 Jul 19 15:55:44.297524 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Name: tempest-TestVolumeBootPattern-1663767670-project Jul 19 15:55:44.297524 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: method: > Jul 19 15:55:44.297524 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: exception: Instance d978b05a-906b-47db-8f20-9a7daaaf67f1 could not be found. Jul 19 15:55:44.297524 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: action_args: {'id': 'd978b05a-906b-47db-8f20-9a7daaaf67f1'} Jul 19 15:55:44.298547 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:55:44.298547 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:55:44.298547 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 15:55:44.298547 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 15:55:44.298547 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 15:55:44.298547 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 15:55:44.298547 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 15:55:44.298547 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 15:55:44.298547 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 15:55:44.298547 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 15:55:44.298547 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d978b05a-906b-47db-8f20-9a7daaaf67f1 could not be found. Jul 19 15:55:44.298547 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:55:44.298547 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:55:44.298547 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:55:44.298547 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:55:44.298547 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:55:44.298547 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:55:44.298547 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:55:44.298547 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:55:44.298547 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:55:44.300087 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:55:44.300087 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 15:55:44.300087 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 15:55:44.300087 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 15:55:44.300087 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 15:55:44.300087 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 15:55:44.300087 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 15:55:44.300087 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d978b05a-906b-47db-8f20-9a7daaaf67f1 could not be found. Jul 19 15:55:44.300087 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:55:44.300087 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:55:44.300087 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:55:44.300087 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:55:44.300087 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:55:44.300087 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:55:44.300087 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:55:44.300087 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:55:44.300087 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d978b05a-906b-47db-8f20-9a7daaaf67f1 could not be found. Jul 19 15:55:44.300087 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:55:44.301458 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-4a1d690f-3896-4cf9-8b10-5bf08a0f7888 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Returning 404 to user: Instance d978b05a-906b-47db-8f20-9a7daaaf67f1 could not be found. {{(pid=129519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:55:44.301458 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-4a1d690f-3896-4cf9-8b10-5bf08a0f7888 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] 10.222.0.64 "GET /compute/v2.1/servers/d978b05a-906b-47db-8f20-9a7daaaf67f1" status: 404 len: 111 microversion: 2.1 time: 0.031228 Jul 19 15:55:44.301458 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 534/1119] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:55:44 2022] GET /compute/v2.1/servers/d978b05a-906b-47db-8f20-9a7daaaf67f1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 15:55:44.616877 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-22ead826-dd92-4d5d-8669-e6e6e0651aa3 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:44.618302 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-22ead826-dd92-4d5d-8669-e6e6e0651aa3 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] [instance: 6a682004-8d98-4d3d-ad12-a1cf82bbaf1e] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:44.625538 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-22ead826-dd92-4d5d-8669-e6e6e0651aa3 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:44.626093 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-22ead826-dd92-4d5d-8669-e6e6e0651aa3 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:44.626981 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-22ead826-dd92-4d5d-8669-e6e6e0651aa3 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:44.627483 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-22ead826-dd92-4d5d-8669-e6e6e0651aa3 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:44.745455 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-12950bb1-8948-494a-8b87-e28575eeeb8e tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:44.745963 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-12950bb1-8948-494a-8b87-e28575eeeb8e tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] [instance: 17f9fd89-e668-4d3d-8d85-e648189ba0c2] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:44.751885 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-12950bb1-8948-494a-8b87-e28575eeeb8e tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:44.752335 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-12950bb1-8948-494a-8b87-e28575eeeb8e tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:44.753156 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-12950bb1-8948-494a-8b87-e28575eeeb8e tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:44.753596 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-12950bb1-8948-494a-8b87-e28575eeeb8e tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:44.767753 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.wsgi [None req-12950bb1-8948-494a-8b87-e28575eeeb8e tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] HTTP exception thrown: Instance 17f9fd89-e668-4d3d-8d85-e648189ba0c2 could not be found. Jul 19 15:55:44.769334 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-12950bb1-8948-494a-8b87-e28575eeeb8e tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Request method failure captured: Jul 19 15:55:44.769334 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: request: DELETE /compute/v2.1/servers/17f9fd89-e668-4d3d-8d85-e648189ba0c2 HTTP/1.1 Jul 19 15:55:44.769334 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Accept: application/json Jul 19 15:55:44.769334 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Accept-Encoding: identity Jul 19 15:55:44.769334 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Connection: close Jul 19 15:55:44.769334 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Content-Length: 0 Jul 19 15:55:44.769334 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Content-Type: application/json Jul 19 15:55:44.769334 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Host: 10.222.0.64 Jul 19 15:55:44.769334 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Openstack-System-Scope: None Jul 19 15:55:44.769334 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: User-Agent: python-urllib3/1.26.9 Jul 19 15:55:44.769334 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Auth-Token: gAAAAABi1tIKmGNKjwQgkw9F_DlegiMzZqtLsl76NPyy0vJQFYgomcM9bzzZELZ_B5F1MJo9XaGabhaizyJFkZqqGK3-DLol0-LA7zgantfqN4gEYaL9Hb74O0C0Egru9kBMuLlaahTktA4ieEsVNRriI3odZ_vPLqGBzvwdDfERnmH70nsEmR0 Jul 19 15:55:44.769334 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Domain-Id: None Jul 19 15:55:44.769334 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Domain-Name: None Jul 19 15:55:44.769334 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Identity-Status: Confirmed Jul 19 15:55:44.769334 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Is-Admin-Project: True Jul 19 15:55:44.769334 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Domain-Id: default Jul 19 15:55:44.769334 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Domain-Name: Default Jul 19 15:55:44.769334 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Id: 6827afcdf1f3481882f808dc01908a4d Jul 19 15:55:44.769334 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Name: tempest-TestVolumeBootPattern-1663767670 Jul 19 15:55:44.769334 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Role: member,reader Jul 19 15:55:44.769334 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Roles: member,reader Jul 19 15:55:44.770998 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_6827afcdf1f3481882f808dc01908a4d", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6827afcdf1f3481882f808dc01908a4d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6827afcdf1f3481882f808dc01908a4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/6827afcdf1f3481882f808dc01908a4d"}]}] Jul 19 15:55:44.770998 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Tenant: tempest-TestVolumeBootPattern-1663767670 Jul 19 15:55:44.770998 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Tenant-Id: 6827afcdf1f3481882f808dc01908a4d Jul 19 15:55:44.770998 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Tenant-Name: tempest-TestVolumeBootPattern-1663767670 Jul 19 15:55:44.770998 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User: tempest-TestVolumeBootPattern-1663767670-project Jul 19 15:55:44.770998 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Domain-Id: default Jul 19 15:55:44.770998 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Domain-Name: Default Jul 19 15:55:44.770998 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Id: ae334c4d93cd4d3e94789a5985fcfa77 Jul 19 15:55:44.770998 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Name: tempest-TestVolumeBootPattern-1663767670-project Jul 19 15:55:44.770998 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: method: > Jul 19 15:55:44.770998 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: exception: Instance 17f9fd89-e668-4d3d-8d85-e648189ba0c2 could not be found. Jul 19 15:55:44.770998 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: action_args: {'id': '17f9fd89-e668-4d3d-8d85-e648189ba0c2'} Jul 19 15:55:44.771935 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:55:44.771935 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:55:44.771935 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 15:55:44.771935 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 15:55:44.771935 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 15:55:44.771935 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 15:55:44.771935 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 15:55:44.771935 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 15:55:44.771935 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 15:55:44.771935 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 15:55:44.771935 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17f9fd89-e668-4d3d-8d85-e648189ba0c2 could not be found. Jul 19 15:55:44.771935 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:55:44.771935 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:55:44.771935 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:55:44.771935 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:55:44.771935 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:55:44.771935 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:55:44.771935 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:55:44.771935 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:55:44.771935 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:55:44.773671 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:55:44.773671 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 19 15:55:44.773671 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 19 15:55:44.773671 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 19 15:55:44.773671 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 19 15:55:44.773671 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 15:55:44.773671 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 15:55:44.773671 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 15:55:44.773671 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 15:55:44.773671 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17f9fd89-e668-4d3d-8d85-e648189ba0c2 could not be found. Jul 19 15:55:44.773671 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:55:44.773671 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:55:44.773671 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:55:44.773671 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:55:44.773671 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:55:44.773671 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:55:44.773671 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:55:44.773671 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:55:44.773671 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17f9fd89-e668-4d3d-8d85-e648189ba0c2 could not be found. Jul 19 15:55:44.773671 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:55:44.775309 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-12950bb1-8948-494a-8b87-e28575eeeb8e tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Returning 404 to user: Instance 17f9fd89-e668-4d3d-8d85-e648189ba0c2 could not be found. {{(pid=129519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:55:44.775309 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-12950bb1-8948-494a-8b87-e28575eeeb8e tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] 10.222.0.64 "DELETE /compute/v2.1/servers/17f9fd89-e668-4d3d-8d85-e648189ba0c2" status: 404 len: 111 microversion: 2.1 time: 0.029738 Jul 19 15:55:44.775309 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 535/1120] 10.222.0.64 () {58 vars in 1238 bytes} [Tue Jul 19 15:55:44 2022] DELETE /compute/v2.1/servers/17f9fd89-e668-4d3d-8d85-e648189ba0c2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 19 15:55:44.777212 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-22ead826-dd92-4d5d-8669-e6e6e0651aa3 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a63627dc4624d9c8b73bcbfcc11fbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9e5f3b931d47b6bfb7938a89c2a37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:55:44.779221 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-488df2a3-a601-4cb0-bfd4-fe886b3d0274 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:44.779830 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-488df2a3-a601-4cb0-bfd4-fe886b3d0274 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] [instance: 17f9fd89-e668-4d3d-8d85-e648189ba0c2] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:44.785376 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-22ead826-dd92-4d5d-8669-e6e6e0651aa3 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] 10.222.0.64 "GET /compute/v2.1/servers/6a682004-8d98-4d3d-ad12-a1cf82bbaf1e" status: 200 len: 1756 microversion: 2.1 time: 0.172298 Jul 19 15:55:44.785622 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-488df2a3-a601-4cb0-bfd4-fe886b3d0274 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:44.786072 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-488df2a3-a601-4cb0-bfd4-fe886b3d0274 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:44.789046 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 586/1121] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:55:44 2022] GET /compute/v2.1/servers/6a682004-8d98-4d3d-ad12-a1cf82bbaf1e => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:55:44.789833 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-488df2a3-a601-4cb0-bfd4-fe886b3d0274 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:44.790270 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-488df2a3-a601-4cb0-bfd4-fe886b3d0274 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:44.803980 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.wsgi [None req-488df2a3-a601-4cb0-bfd4-fe886b3d0274 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] HTTP exception thrown: Instance 17f9fd89-e668-4d3d-8d85-e648189ba0c2 could not be found. Jul 19 15:55:44.806344 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-488df2a3-a601-4cb0-bfd4-fe886b3d0274 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Request method failure captured: Jul 19 15:55:44.806344 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: request: GET /compute/v2.1/servers/17f9fd89-e668-4d3d-8d85-e648189ba0c2 HTTP/1.1 Jul 19 15:55:44.806344 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Accept: application/json Jul 19 15:55:44.806344 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Accept-Encoding: identity Jul 19 15:55:44.806344 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Connection: close Jul 19 15:55:44.806344 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Content-Length: 0 Jul 19 15:55:44.806344 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Content-Type: application/json Jul 19 15:55:44.806344 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Host: 10.222.0.64 Jul 19 15:55:44.806344 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Openstack-System-Scope: None Jul 19 15:55:44.806344 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: User-Agent: python-urllib3/1.26.9 Jul 19 15:55:44.806344 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Auth-Token: gAAAAABi1tIKmGNKjwQgkw9F_DlegiMzZqtLsl76NPyy0vJQFYgomcM9bzzZELZ_B5F1MJo9XaGabhaizyJFkZqqGK3-DLol0-LA7zgantfqN4gEYaL9Hb74O0C0Egru9kBMuLlaahTktA4ieEsVNRriI3odZ_vPLqGBzvwdDfERnmH70nsEmR0 Jul 19 15:55:44.806344 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Domain-Id: None Jul 19 15:55:44.806344 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Domain-Name: None Jul 19 15:55:44.806344 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Identity-Status: Confirmed Jul 19 15:55:44.806344 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Is-Admin-Project: True Jul 19 15:55:44.806344 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Domain-Id: default Jul 19 15:55:44.806344 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Domain-Name: Default Jul 19 15:55:44.806344 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Id: 6827afcdf1f3481882f808dc01908a4d Jul 19 15:55:44.806344 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Name: tempest-TestVolumeBootPattern-1663767670 Jul 19 15:55:44.806344 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Role: member,reader Jul 19 15:55:44.806344 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Roles: member,reader Jul 19 15:55:44.807996 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_6827afcdf1f3481882f808dc01908a4d", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6827afcdf1f3481882f808dc01908a4d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6827afcdf1f3481882f808dc01908a4d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/6827afcdf1f3481882f808dc01908a4d"}]}] Jul 19 15:55:44.807996 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Tenant: tempest-TestVolumeBootPattern-1663767670 Jul 19 15:55:44.807996 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Tenant-Id: 6827afcdf1f3481882f808dc01908a4d Jul 19 15:55:44.807996 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Tenant-Name: tempest-TestVolumeBootPattern-1663767670 Jul 19 15:55:44.807996 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User: tempest-TestVolumeBootPattern-1663767670-project Jul 19 15:55:44.807996 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Domain-Id: default Jul 19 15:55:44.807996 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Domain-Name: Default Jul 19 15:55:44.807996 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Id: ae334c4d93cd4d3e94789a5985fcfa77 Jul 19 15:55:44.807996 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Name: tempest-TestVolumeBootPattern-1663767670-project Jul 19 15:55:44.807996 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: method: > Jul 19 15:55:44.807996 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: exception: Instance 17f9fd89-e668-4d3d-8d85-e648189ba0c2 could not be found. Jul 19 15:55:44.807996 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: action_args: {'id': '17f9fd89-e668-4d3d-8d85-e648189ba0c2'} Jul 19 15:55:44.808847 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:55:44.808847 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:55:44.808847 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 15:55:44.808847 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 15:55:44.808847 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 15:55:44.808847 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 15:55:44.808847 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 15:55:44.808847 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 15:55:44.808847 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 15:55:44.808847 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 15:55:44.808847 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 17f9fd89-e668-4d3d-8d85-e648189ba0c2 could not be found. Jul 19 15:55:44.808847 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:55:44.808847 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:55:44.808847 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:55:44.808847 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:55:44.808847 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:55:44.808847 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:55:44.808847 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:55:44.808847 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:55:44.808847 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:55:44.810242 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:55:44.810242 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 15:55:44.810242 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 15:55:44.810242 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 15:55:44.810242 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 15:55:44.810242 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 15:55:44.810242 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 15:55:44.810242 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 17f9fd89-e668-4d3d-8d85-e648189ba0c2 could not be found. Jul 19 15:55:44.810242 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:55:44.810242 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:55:44.810242 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:55:44.810242 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:55:44.810242 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:55:44.810242 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:55:44.810242 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:55:44.810242 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:55:44.810242 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 17f9fd89-e668-4d3d-8d85-e648189ba0c2 could not be found. Jul 19 15:55:44.810242 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:55:44.811707 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-488df2a3-a601-4cb0-bfd4-fe886b3d0274 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Returning 404 to user: Instance 17f9fd89-e668-4d3d-8d85-e648189ba0c2 could not be found. {{(pid=129519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:55:44.811707 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-488df2a3-a601-4cb0-bfd4-fe886b3d0274 tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] 10.222.0.64 "GET /compute/v2.1/servers/17f9fd89-e668-4d3d-8d85-e648189ba0c2" status: 404 len: 111 microversion: 2.1 time: 0.032137 Jul 19 15:55:44.811707 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 536/1122] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:55:44 2022] GET /compute/v2.1/servers/17f9fd89-e668-4d3d-8d85-e648189ba0c2 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 15:55:45.802909 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-f8ab85db-2f07-43b6-938f-e5e19249cc68 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:45.803511 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-f8ab85db-2f07-43b6-938f-e5e19249cc68 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] [instance: 6a682004-8d98-4d3d-ad12-a1cf82bbaf1e] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:45.809806 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-f8ab85db-2f07-43b6-938f-e5e19249cc68 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:45.810249 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-f8ab85db-2f07-43b6-938f-e5e19249cc68 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:45.811036 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-f8ab85db-2f07-43b6-938f-e5e19249cc68 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:45.811463 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-f8ab85db-2f07-43b6-938f-e5e19249cc68 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:45.975084 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-f8ab85db-2f07-43b6-938f-e5e19249cc68 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a63627dc4624d9c8b73bcbfcc11fbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9e5f3b931d47b6bfb7938a89c2a37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:55:45.983862 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-f8ab85db-2f07-43b6-938f-e5e19249cc68 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] 10.222.0.64 "GET /compute/v2.1/servers/6a682004-8d98-4d3d-ad12-a1cf82bbaf1e" status: 200 len: 1756 microversion: 2.1 time: 0.184736 Jul 19 15:55:45.984756 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 587/1123] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:55:45 2022] GET /compute/v2.1/servers/6a682004-8d98-4d3d-ad12-a1cf82bbaf1e => generated 1756 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:55:46.114972 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-b5b65efa-453c-4559-8d93-6aecf689e00b tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] Calling method '.version_select at 0x7fb8a5a82ee0>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:46.137413 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-b5b65efa-453c-4559-8d93-6aecf689e00b tempest-TestVolumeBootPattern-1663767670 tempest-TestVolumeBootPattern-1663767670-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-701832674" status: 202 len: 0 microversion: 2.1 time: 0.029848 Jul 19 15:55:46.137876 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 537/1124] 10.222.0.64 () {58 vars in 1259 bytes} [Tue Jul 19 15:55:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-701832674 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 15:55:47.001062 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-5c5cfea9-1cc8-4982-ae20-ba82984a6f78 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:55:47.001666 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-5c5cfea9-1cc8-4982-ae20-ba82984a6f78 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] [instance: 6a682004-8d98-4d3d-ad12-a1cf82bbaf1e] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:55:47.008312 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-5c5cfea9-1cc8-4982-ae20-ba82984a6f78 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:47.008754 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-5c5cfea9-1cc8-4982-ae20-ba82984a6f78 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:47.009513 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-5c5cfea9-1cc8-4982-ae20-ba82984a6f78 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:55:47.009958 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-5c5cfea9-1cc8-4982-ae20-ba82984a6f78 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:55:47.160222 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-5c5cfea9-1cc8-4982-ae20-ba82984a6f78 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a63627dc4624d9c8b73bcbfcc11fbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9e5f3b931d47b6bfb7938a89c2a37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:55:47.169669 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-5c5cfea9-1cc8-4982-ae20-ba82984a6f78 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] 10.222.0.64 "GET /compute/v2.1/servers/6a682004-8d98-4d3d-ad12-a1cf82bbaf1e" status: 200 len: 1759 microversion: 2.1 time: 0.172141 Jul 19 15:55:47.170570 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 588/1125] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:55:46 2022] GET /compute/v2.1/servers/6a682004-8d98-4d3d-ad12-a1cf82bbaf1e => generated 1759 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:56:00.949246 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG dbcounter [-] [129519] Writing DB stats nova_cell1:SELECT=12 {{(pid=129519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:56:00.950028 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG dbcounter [-] [129519] Writing DB stats nova_api:SELECT=47,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=129519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:56:00.954917 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-3bc7794a-b393-4901-bab2-6a029ef79e13 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:56:00.955498 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-3bc7794a-b393-4901-bab2-6a029ef79e13 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] [instance: 40d79e6b-f23e-47aa-bb6c-04c1a6605256] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:56:00.964544 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-3bc7794a-b393-4901-bab2-6a029ef79e13 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:00.964996 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-3bc7794a-b393-4901-bab2-6a029ef79e13 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:00.965767 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-3bc7794a-b393-4901-bab2-6a029ef79e13 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:00.966207 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-3bc7794a-b393-4901-bab2-6a029ef79e13 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:00.988680 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.objects.instance [None req-3bc7794a-b393-4901-bab2-6a029ef79e13 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lazy-loading 'flavor' on Instance uuid 40d79e6b-f23e-47aa-bb6c-04c1a6605256 {{(pid=129519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 15:56:01.060050 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-3bc7794a-b393-4901-bab2-6a029ef79e13 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] 10.222.0.64 "POST /compute/v2.1/servers/40d79e6b-f23e-47aa-bb6c-04c1a6605256/action" status: 202 len: 0 microversion: 2.1 time: 0.111986 Jul 19 15:56:01.060676 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 538/1126] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Jul 19 15:56:00 2022] POST /compute/v2.1/servers/40d79e6b-f23e-47aa-bb6c-04c1a6605256/action => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 15:56:01.069074 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-520bda79-b76a-4559-a728-fe0c01fa964a tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:56:01.070228 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-520bda79-b76a-4559-a728-fe0c01fa964a tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] [instance: 40d79e6b-f23e-47aa-bb6c-04c1a6605256] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:56:01.073356 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG dbcounter [-] [129520] Writing DB stats nova_api:SELECT=36 {{(pid=129520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:56:01.074020 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG dbcounter [-] [129520] Writing DB stats nova_cell1:SELECT=84 {{(pid=129520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:56:01.079443 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-520bda79-b76a-4559-a728-fe0c01fa964a tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:01.079897 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-520bda79-b76a-4559-a728-fe0c01fa964a tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:01.080669 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-520bda79-b76a-4559-a728-fe0c01fa964a tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:01.081121 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-520bda79-b76a-4559-a728-fe0c01fa964a tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:01.220572 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-520bda79-b76a-4559-a728-fe0c01fa964a tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674d054767ff4eec993ca7fefdce3967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf521f7d98c641d4941eb041acf65405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:56:01.232279 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-520bda79-b76a-4559-a728-fe0c01fa964a tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] 10.222.0.64 "GET /compute/v2.1/servers/40d79e6b-f23e-47aa-bb6c-04c1a6605256" status: 200 len: 1564 microversion: 2.1 time: 0.167137 Jul 19 15:56:01.232858 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 589/1127] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:56:01 2022] GET /compute/v2.1/servers/40d79e6b-f23e-47aa-bb6c-04c1a6605256 => generated 1564 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:56:02.250167 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-8b183522-0eea-49cd-9820-55c7cfefaaaa tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:56:02.250916 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-8b183522-0eea-49cd-9820-55c7cfefaaaa tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] [instance: 40d79e6b-f23e-47aa-bb6c-04c1a6605256] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:56:02.257889 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-8b183522-0eea-49cd-9820-55c7cfefaaaa tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:02.258470 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-8b183522-0eea-49cd-9820-55c7cfefaaaa tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:02.259241 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-8b183522-0eea-49cd-9820-55c7cfefaaaa tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:02.259680 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-8b183522-0eea-49cd-9820-55c7cfefaaaa tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:02.391465 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-8b183522-0eea-49cd-9820-55c7cfefaaaa tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674d054767ff4eec993ca7fefdce3967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf521f7d98c641d4941eb041acf65405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:56:02.399250 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-8b183522-0eea-49cd-9820-55c7cfefaaaa tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] 10.222.0.64 "GET /compute/v2.1/servers/40d79e6b-f23e-47aa-bb6c-04c1a6605256" status: 200 len: 1564 microversion: 2.1 time: 0.153748 Jul 19 15:56:02.399818 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 539/1128] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:56:02 2022] GET /compute/v2.1/servers/40d79e6b-f23e-47aa-bb6c-04c1a6605256 => generated 1564 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:56:03.418266 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-8899af4f-7f55-4e5d-ab44-3f835447d149 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:56:03.419173 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-8899af4f-7f55-4e5d-ab44-3f835447d149 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] [instance: 40d79e6b-f23e-47aa-bb6c-04c1a6605256] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:56:03.425783 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-8899af4f-7f55-4e5d-ab44-3f835447d149 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:03.426216 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-8899af4f-7f55-4e5d-ab44-3f835447d149 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:03.427024 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-8899af4f-7f55-4e5d-ab44-3f835447d149 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:03.427447 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-8899af4f-7f55-4e5d-ab44-3f835447d149 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:03.557949 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-8899af4f-7f55-4e5d-ab44-3f835447d149 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674d054767ff4eec993ca7fefdce3967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf521f7d98c641d4941eb041acf65405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:56:03.565454 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-8899af4f-7f55-4e5d-ab44-3f835447d149 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] 10.222.0.64 "GET /compute/v2.1/servers/40d79e6b-f23e-47aa-bb6c-04c1a6605256" status: 200 len: 1564 microversion: 2.1 time: 0.152714 Jul 19 15:56:03.566012 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 590/1129] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:56:03 2022] GET /compute/v2.1/servers/40d79e6b-f23e-47aa-bb6c-04c1a6605256 => generated 1564 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:56:04.583351 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-5517421a-c133-4da7-b851-c335a0011de3 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:56:04.583987 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-5517421a-c133-4da7-b851-c335a0011de3 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] [instance: 40d79e6b-f23e-47aa-bb6c-04c1a6605256] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:56:04.591073 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-5517421a-c133-4da7-b851-c335a0011de3 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:04.591526 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-5517421a-c133-4da7-b851-c335a0011de3 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:04.592289 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-5517421a-c133-4da7-b851-c335a0011de3 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:04.592729 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-5517421a-c133-4da7-b851-c335a0011de3 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:04.721371 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-5517421a-c133-4da7-b851-c335a0011de3 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674d054767ff4eec993ca7fefdce3967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf521f7d98c641d4941eb041acf65405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:56:04.729053 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-5517421a-c133-4da7-b851-c335a0011de3 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] 10.222.0.64 "GET /compute/v2.1/servers/40d79e6b-f23e-47aa-bb6c-04c1a6605256" status: 200 len: 1564 microversion: 2.1 time: 0.149582 Jul 19 15:56:04.729611 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 540/1130] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:56:04 2022] GET /compute/v2.1/servers/40d79e6b-f23e-47aa-bb6c-04c1a6605256 => generated 1564 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:56:05.746113 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-7e2c0549-7d4d-4ff4-8819-259fbe747d07 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:56:05.746753 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-7e2c0549-7d4d-4ff4-8819-259fbe747d07 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] [instance: 40d79e6b-f23e-47aa-bb6c-04c1a6605256] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:56:05.753348 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-7e2c0549-7d4d-4ff4-8819-259fbe747d07 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:05.753796 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-7e2c0549-7d4d-4ff4-8819-259fbe747d07 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:05.754628 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-7e2c0549-7d4d-4ff4-8819-259fbe747d07 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:05.755062 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-7e2c0549-7d4d-4ff4-8819-259fbe747d07 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:05.888538 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-7e2c0549-7d4d-4ff4-8819-259fbe747d07 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674d054767ff4eec993ca7fefdce3967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf521f7d98c641d4941eb041acf65405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:56:05.896133 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-7e2c0549-7d4d-4ff4-8819-259fbe747d07 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] 10.222.0.64 "GET /compute/v2.1/servers/40d79e6b-f23e-47aa-bb6c-04c1a6605256" status: 200 len: 1564 microversion: 2.1 time: 0.153919 Jul 19 15:56:05.896699 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 591/1131] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:56:05 2022] GET /compute/v2.1/servers/40d79e6b-f23e-47aa-bb6c-04c1a6605256 => generated 1564 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:56:06.913350 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-d90857fd-7714-4a55-a574-1f1182e09d14 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:56:06.914600 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-d90857fd-7714-4a55-a574-1f1182e09d14 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] [instance: 40d79e6b-f23e-47aa-bb6c-04c1a6605256] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:56:06.921672 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-d90857fd-7714-4a55-a574-1f1182e09d14 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:06.922118 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-d90857fd-7714-4a55-a574-1f1182e09d14 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:06.922920 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-d90857fd-7714-4a55-a574-1f1182e09d14 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:06.923361 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-d90857fd-7714-4a55-a574-1f1182e09d14 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:07.329361 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-d90857fd-7714-4a55-a574-1f1182e09d14 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674d054767ff4eec993ca7fefdce3967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf521f7d98c641d4941eb041acf65405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:56:07.337649 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-d90857fd-7714-4a55-a574-1f1182e09d14 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] 10.222.0.64 "GET /compute/v2.1/servers/40d79e6b-f23e-47aa-bb6c-04c1a6605256" status: 200 len: 1564 microversion: 2.1 time: 0.428448 Jul 19 15:56:07.338213 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 541/1132] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:56:06 2022] GET /compute/v2.1/servers/40d79e6b-f23e-47aa-bb6c-04c1a6605256 => generated 1564 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:56:08.355061 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-76a3359e-a11b-4b48-8683-7c96efbf46d8 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:56:08.355704 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-76a3359e-a11b-4b48-8683-7c96efbf46d8 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] [instance: 40d79e6b-f23e-47aa-bb6c-04c1a6605256] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:56:08.362150 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-76a3359e-a11b-4b48-8683-7c96efbf46d8 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:08.362635 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-76a3359e-a11b-4b48-8683-7c96efbf46d8 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:08.363393 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-76a3359e-a11b-4b48-8683-7c96efbf46d8 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:08.363825 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-76a3359e-a11b-4b48-8683-7c96efbf46d8 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:08.494416 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-76a3359e-a11b-4b48-8683-7c96efbf46d8 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674d054767ff4eec993ca7fefdce3967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf521f7d98c641d4941eb041acf65405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:56:08.501979 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-76a3359e-a11b-4b48-8683-7c96efbf46d8 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] 10.222.0.64 "GET /compute/v2.1/servers/40d79e6b-f23e-47aa-bb6c-04c1a6605256" status: 200 len: 1564 microversion: 2.1 time: 0.151279 Jul 19 15:56:08.502582 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 592/1133] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:56:08 2022] GET /compute/v2.1/servers/40d79e6b-f23e-47aa-bb6c-04c1a6605256 => generated 1564 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:56:09.519291 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-9f64c104-aeb1-461b-aaa6-865610792143 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:56:09.519899 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-9f64c104-aeb1-461b-aaa6-865610792143 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] [instance: 40d79e6b-f23e-47aa-bb6c-04c1a6605256] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:56:09.526429 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-9f64c104-aeb1-461b-aaa6-865610792143 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:09.526868 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-9f64c104-aeb1-461b-aaa6-865610792143 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:09.527613 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-9f64c104-aeb1-461b-aaa6-865610792143 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:09.528044 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-9f64c104-aeb1-461b-aaa6-865610792143 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:09.657451 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-9f64c104-aeb1-461b-aaa6-865610792143 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674d054767ff4eec993ca7fefdce3967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf521f7d98c641d4941eb041acf65405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:56:09.665591 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-9f64c104-aeb1-461b-aaa6-865610792143 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] 10.222.0.64 "GET /compute/v2.1/servers/40d79e6b-f23e-47aa-bb6c-04c1a6605256" status: 200 len: 1564 microversion: 2.1 time: 0.150224 Jul 19 15:56:09.666179 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 542/1134] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:56:09 2022] GET /compute/v2.1/servers/40d79e6b-f23e-47aa-bb6c-04c1a6605256 => generated 1564 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:56:10.683654 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-349d38f7-dfdb-4042-9330-5db4575fdd00 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:56:10.684437 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-349d38f7-dfdb-4042-9330-5db4575fdd00 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] [instance: 40d79e6b-f23e-47aa-bb6c-04c1a6605256] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:56:10.690962 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-349d38f7-dfdb-4042-9330-5db4575fdd00 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:10.691406 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-349d38f7-dfdb-4042-9330-5db4575fdd00 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:10.692159 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-349d38f7-dfdb-4042-9330-5db4575fdd00 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:10.692591 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-349d38f7-dfdb-4042-9330-5db4575fdd00 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:10.823267 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-349d38f7-dfdb-4042-9330-5db4575fdd00 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674d054767ff4eec993ca7fefdce3967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf521f7d98c641d4941eb041acf65405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:56:10.830724 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-349d38f7-dfdb-4042-9330-5db4575fdd00 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] 10.222.0.64 "GET /compute/v2.1/servers/40d79e6b-f23e-47aa-bb6c-04c1a6605256" status: 200 len: 1564 microversion: 2.1 time: 0.151624 Jul 19 15:56:10.831287 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 593/1135] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:56:10 2022] GET /compute/v2.1/servers/40d79e6b-f23e-47aa-bb6c-04c1a6605256 => generated 1564 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:56:11.847771 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-c70d9831-372b-4017-8c42-ba0a73d11a61 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:56:11.848424 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-c70d9831-372b-4017-8c42-ba0a73d11a61 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] [instance: 40d79e6b-f23e-47aa-bb6c-04c1a6605256] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:56:11.855642 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-c70d9831-372b-4017-8c42-ba0a73d11a61 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:11.856088 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-c70d9831-372b-4017-8c42-ba0a73d11a61 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:11.856844 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-c70d9831-372b-4017-8c42-ba0a73d11a61 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:11.857370 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-c70d9831-372b-4017-8c42-ba0a73d11a61 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:11.991588 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-c70d9831-372b-4017-8c42-ba0a73d11a61 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674d054767ff4eec993ca7fefdce3967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf521f7d98c641d4941eb041acf65405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:56:11.999153 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-c70d9831-372b-4017-8c42-ba0a73d11a61 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] 10.222.0.64 "GET /compute/v2.1/servers/40d79e6b-f23e-47aa-bb6c-04c1a6605256" status: 200 len: 1564 microversion: 2.1 time: 0.155341 Jul 19 15:56:11.999706 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 543/1136] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:56:11 2022] GET /compute/v2.1/servers/40d79e6b-f23e-47aa-bb6c-04c1a6605256 => generated 1564 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:56:13.016189 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-99af7b04-b006-4c74-b98e-82d709a9ccc1 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:56:13.016727 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-99af7b04-b006-4c74-b98e-82d709a9ccc1 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] [instance: 40d79e6b-f23e-47aa-bb6c-04c1a6605256] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:56:13.023164 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-99af7b04-b006-4c74-b98e-82d709a9ccc1 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:13.023604 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-99af7b04-b006-4c74-b98e-82d709a9ccc1 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:13.024348 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-99af7b04-b006-4c74-b98e-82d709a9ccc1 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:13.024774 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-99af7b04-b006-4c74-b98e-82d709a9ccc1 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:13.405040 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-99af7b04-b006-4c74-b98e-82d709a9ccc1 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674d054767ff4eec993ca7fefdce3967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf521f7d98c641d4941eb041acf65405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:56:13.412734 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-99af7b04-b006-4c74-b98e-82d709a9ccc1 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] 10.222.0.64 "GET /compute/v2.1/servers/40d79e6b-f23e-47aa-bb6c-04c1a6605256" status: 200 len: 1564 microversion: 2.1 time: 0.400518 Jul 19 15:56:13.413659 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 594/1137] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:56:13 2022] GET /compute/v2.1/servers/40d79e6b-f23e-47aa-bb6c-04c1a6605256 => generated 1564 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:56:14.431690 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-2c5db13b-4b5b-42d2-88a1-4e8d4fba1e90 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:56:14.432291 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-2c5db13b-4b5b-42d2-88a1-4e8d4fba1e90 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] [instance: 40d79e6b-f23e-47aa-bb6c-04c1a6605256] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:56:14.438904 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-2c5db13b-4b5b-42d2-88a1-4e8d4fba1e90 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:14.439351 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-2c5db13b-4b5b-42d2-88a1-4e8d4fba1e90 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:14.440111 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-2c5db13b-4b5b-42d2-88a1-4e8d4fba1e90 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:14.440536 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-2c5db13b-4b5b-42d2-88a1-4e8d4fba1e90 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:14.572081 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-2c5db13b-4b5b-42d2-88a1-4e8d4fba1e90 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674d054767ff4eec993ca7fefdce3967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf521f7d98c641d4941eb041acf65405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:56:14.579715 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-2c5db13b-4b5b-42d2-88a1-4e8d4fba1e90 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] 10.222.0.64 "GET /compute/v2.1/servers/40d79e6b-f23e-47aa-bb6c-04c1a6605256" status: 200 len: 1505 microversion: 2.1 time: 0.152024 Jul 19 15:56:14.580284 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 544/1138] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:56:14 2022] GET /compute/v2.1/servers/40d79e6b-f23e-47aa-bb6c-04c1a6605256 => generated 1505 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:56:14.595881 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-dfe6d4cc-0dd7-42bd-8101-621975cda30e tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:56:14.596450 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-dfe6d4cc-0dd7-42bd-8101-621975cda30e tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] [instance: 40d79e6b-f23e-47aa-bb6c-04c1a6605256] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:56:14.603695 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-dfe6d4cc-0dd7-42bd-8101-621975cda30e tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:14.604142 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-dfe6d4cc-0dd7-42bd-8101-621975cda30e tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:14.604905 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-dfe6d4cc-0dd7-42bd-8101-621975cda30e tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:14.605341 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-dfe6d4cc-0dd7-42bd-8101-621975cda30e tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:14.688510 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-dfe6d4cc-0dd7-42bd-8101-621975cda30e tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] 10.222.0.64 "POST /compute/v2.1/servers/40d79e6b-f23e-47aa-bb6c-04c1a6605256/action" status: 202 len: 0 microversion: 2.1 time: 0.096220 Jul 19 15:56:14.692277 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 595/1139] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Jul 19 15:56:14 2022] POST /compute/v2.1/servers/40d79e6b-f23e-47aa-bb6c-04c1a6605256/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 15:56:14.699801 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-f0e26d91-d164-4f34-b2ee-3f1a1dfcd13f tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:56:14.700406 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-f0e26d91-d164-4f34-b2ee-3f1a1dfcd13f tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] [instance: 40d79e6b-f23e-47aa-bb6c-04c1a6605256] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:56:14.706396 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-f0e26d91-d164-4f34-b2ee-3f1a1dfcd13f tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:14.706853 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-f0e26d91-d164-4f34-b2ee-3f1a1dfcd13f tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:14.707621 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-f0e26d91-d164-4f34-b2ee-3f1a1dfcd13f tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:14.708163 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-f0e26d91-d164-4f34-b2ee-3f1a1dfcd13f tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:14.909053 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-f0e26d91-d164-4f34-b2ee-3f1a1dfcd13f tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674d054767ff4eec993ca7fefdce3967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf521f7d98c641d4941eb041acf65405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:56:14.917182 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-f0e26d91-d164-4f34-b2ee-3f1a1dfcd13f tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] 10.222.0.64 "GET /compute/v2.1/servers/40d79e6b-f23e-47aa-bb6c-04c1a6605256" status: 200 len: 1513 microversion: 2.1 time: 0.221306 Jul 19 15:56:14.917742 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 545/1140] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:56:14 2022] GET /compute/v2.1/servers/40d79e6b-f23e-47aa-bb6c-04c1a6605256 => generated 1513 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:56:15.936253 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-5d8553c5-4aec-4c88-bc8a-df1a6983bc6c tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:56:15.936871 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-5d8553c5-4aec-4c88-bc8a-df1a6983bc6c tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] [instance: 40d79e6b-f23e-47aa-bb6c-04c1a6605256] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:56:15.942953 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-5d8553c5-4aec-4c88-bc8a-df1a6983bc6c tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:15.943399 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-5d8553c5-4aec-4c88-bc8a-df1a6983bc6c tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:15.944168 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-5d8553c5-4aec-4c88-bc8a-df1a6983bc6c tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:15.944604 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-5d8553c5-4aec-4c88-bc8a-df1a6983bc6c tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:16.074252 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-5d8553c5-4aec-4c88-bc8a-df1a6983bc6c tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674d054767ff4eec993ca7fefdce3967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf521f7d98c641d4941eb041acf65405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:56:16.081843 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-5d8553c5-4aec-4c88-bc8a-df1a6983bc6c tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] 10.222.0.64 "GET /compute/v2.1/servers/40d79e6b-f23e-47aa-bb6c-04c1a6605256" status: 200 len: 1571 microversion: 2.1 time: 0.149641 Jul 19 15:56:16.082435 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 596/1141] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:56:15 2022] GET /compute/v2.1/servers/40d79e6b-f23e-47aa-bb6c-04c1a6605256 => generated 1571 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:56:17.100098 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-436d0f71-4d49-445a-895f-cff9572ccd48 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:56:17.100713 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-436d0f71-4d49-445a-895f-cff9572ccd48 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] [instance: 40d79e6b-f23e-47aa-bb6c-04c1a6605256] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:56:17.107953 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-436d0f71-4d49-445a-895f-cff9572ccd48 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:17.108438 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-436d0f71-4d49-445a-895f-cff9572ccd48 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:17.109206 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-436d0f71-4d49-445a-895f-cff9572ccd48 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:17.109649 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-436d0f71-4d49-445a-895f-cff9572ccd48 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:17.247038 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-436d0f71-4d49-445a-895f-cff9572ccd48 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674d054767ff4eec993ca7fefdce3967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf521f7d98c641d4941eb041acf65405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:56:17.254462 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-436d0f71-4d49-445a-895f-cff9572ccd48 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] 10.222.0.64 "GET /compute/v2.1/servers/40d79e6b-f23e-47aa-bb6c-04c1a6605256" status: 200 len: 1571 microversion: 2.1 time: 0.158237 Jul 19 15:56:17.255018 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 546/1142] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:56:17 2022] GET /compute/v2.1/servers/40d79e6b-f23e-47aa-bb6c-04c1a6605256 => generated 1571 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:56:17.678926 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [req-f48899aa-59b6-4101-b16b-e0b6ea2d68e2 req-3c13f7eb-02f4-46ec-b5ba-2404ecac9014 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40d79e6b-f23e-47aa-bb6c-04c1a6605256", "name": "network-vif-unplugged", "status": "completed", "tag": "1afaa31f-2b36-4dde-a958-b15bf3c12a62"}]} {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:56:17.687110 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [req-f48899aa-59b6-4101-b16b-e0b6ea2d68e2 req-3c13f7eb-02f4-46ec-b5ba-2404ecac9014 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:17.687557 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [req-f48899aa-59b6-4101-b16b-e0b6ea2d68e2 req-3c13f7eb-02f4-46ec-b5ba-2404ecac9014 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:17.698234 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.compute.server_external_events [req-f48899aa-59b6-4101-b16b-e0b6ea2d68e2 req-3c13f7eb-02f4-46ec-b5ba-2404ecac9014 service nova] Creating event network-vif-unplugged:1afaa31f-2b36-4dde-a958-b15bf3c12a62 for instance 40d79e6b-f23e-47aa-bb6c-04c1a6605256 on hv-cinder-84902 Jul 19 15:56:17.703266 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [req-f48899aa-59b6-4101-b16b-e0b6ea2d68e2 req-3c13f7eb-02f4-46ec-b5ba-2404ecac9014 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.150757 Jul 19 15:56:17.703904 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 597/1143] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Jul 19 15:56:17 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 15:56:18.270830 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-65f3874d-47f5-4381-b3dc-8984a7d8dc2a tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:56:18.271396 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-65f3874d-47f5-4381-b3dc-8984a7d8dc2a tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] [instance: 40d79e6b-f23e-47aa-bb6c-04c1a6605256] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:56:18.278464 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-65f3874d-47f5-4381-b3dc-8984a7d8dc2a tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:18.278911 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-65f3874d-47f5-4381-b3dc-8984a7d8dc2a tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:18.279665 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-65f3874d-47f5-4381-b3dc-8984a7d8dc2a tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:18.280097 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-65f3874d-47f5-4381-b3dc-8984a7d8dc2a tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:18.410378 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-65f3874d-47f5-4381-b3dc-8984a7d8dc2a tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674d054767ff4eec993ca7fefdce3967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf521f7d98c641d4941eb041acf65405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:56:18.420360 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-65f3874d-47f5-4381-b3dc-8984a7d8dc2a tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] 10.222.0.64 "GET /compute/v2.1/servers/40d79e6b-f23e-47aa-bb6c-04c1a6605256" status: 200 len: 1571 microversion: 2.1 time: 0.153329 Jul 19 15:56:18.421118 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 547/1144] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:56:18 2022] GET /compute/v2.1/servers/40d79e6b-f23e-47aa-bb6c-04c1a6605256 => generated 1571 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:56:19.190588 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-be8ea855-8860-4e95-a627-f77e48b3b43a tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1693911727"}} {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:56:19.191211 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-be8ea855-8860-4e95-a627-f77e48b3b43a tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] [instance: 6a682004-8d98-4d3d-ad12-a1cf82bbaf1e] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:56:19.198026 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-be8ea855-8860-4e95-a627-f77e48b3b43a tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:19.198513 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-be8ea855-8860-4e95-a627-f77e48b3b43a tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:19.199268 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-be8ea855-8860-4e95-a627-f77e48b3b43a tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:19.199731 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-be8ea855-8860-4e95-a627-f77e48b3b43a tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:19.329124 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.network.security_group_api [None req-be8ea855-8860-4e95-a627-f77e48b3b43a tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Removing security group 5e2b31de-b841-4b95-ba90-d36a9688578b from port 818b1333-97cf-4dc6-b490-98d025379610 Jul 19 15:56:19.438040 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-d945814c-5d7b-4748-ae29-fc54c2d17700 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:56:19.438667 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-d945814c-5d7b-4748-ae29-fc54c2d17700 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] [instance: 40d79e6b-f23e-47aa-bb6c-04c1a6605256] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:56:19.445994 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-d945814c-5d7b-4748-ae29-fc54c2d17700 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:19.446386 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-d945814c-5d7b-4748-ae29-fc54c2d17700 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:19.447144 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-d945814c-5d7b-4748-ae29-fc54c2d17700 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:19.447570 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-d945814c-5d7b-4748-ae29-fc54c2d17700 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:19.580145 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-d945814c-5d7b-4748-ae29-fc54c2d17700 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674d054767ff4eec993ca7fefdce3967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf521f7d98c641d4941eb041acf65405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:56:19.587785 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-d945814c-5d7b-4748-ae29-fc54c2d17700 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] 10.222.0.64 "GET /compute/v2.1/servers/40d79e6b-f23e-47aa-bb6c-04c1a6605256" status: 200 len: 1571 microversion: 2.1 time: 0.153646 Jul 19 15:56:19.588352 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 548/1145] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:56:19 2022] GET /compute/v2.1/servers/40d79e6b-f23e-47aa-bb6c-04c1a6605256 => generated 1571 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:56:19.677433 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-be8ea855-8860-4e95-a627-f77e48b3b43a tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] 10.222.0.64 "POST /compute/v2.1/servers/6a682004-8d98-4d3d-ad12-a1cf82bbaf1e/action" status: 202 len: 0 microversion: 2.1 time: 0.491500 Jul 19 15:56:19.688454 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 598/1146] 10.222.0.64 () {60 vars in 1277 bytes} [Tue Jul 19 15:56:19 2022] POST /compute/v2.1/servers/6a682004-8d98-4d3d-ad12-a1cf82bbaf1e/action => generated 0 bytes in 503 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 15:56:19.775616 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [req-2e290058-b49f-4c37-8ef8-7362632fd177 req-71b6819f-a375-4efc-9e33-7b272b3ffc26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a682004-8d98-4d3d-ad12-a1cf82bbaf1e", "tag": "818b1333-97cf-4dc6-b490-98d025379610"}]} {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:56:19.795431 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [req-2e290058-b49f-4c37-8ef8-7362632fd177 req-71b6819f-a375-4efc-9e33-7b272b3ffc26 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:19.796233 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [req-2e290058-b49f-4c37-8ef8-7362632fd177 req-71b6819f-a375-4efc-9e33-7b272b3ffc26 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:19.811768 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.compute.server_external_events [req-2e290058-b49f-4c37-8ef8-7362632fd177 req-71b6819f-a375-4efc-9e33-7b272b3ffc26 service nova] Creating event network-changed:818b1333-97cf-4dc6-b490-98d025379610 for instance 6a682004-8d98-4d3d-ad12-a1cf82bbaf1e on hv-cinder-84902 Jul 19 15:56:19.818649 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [req-2e290058-b49f-4c37-8ef8-7362632fd177 req-71b6819f-a375-4efc-9e33-7b272b3ffc26 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.128523 Jul 19 15:56:19.821400 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 549/1147] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Jul 19 15:56:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:56:20.605632 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-aafc5aae-5efd-4534-afb2-64e898ff3fc8 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:56:20.606302 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-aafc5aae-5efd-4534-afb2-64e898ff3fc8 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] [instance: 40d79e6b-f23e-47aa-bb6c-04c1a6605256] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:56:20.612486 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-aafc5aae-5efd-4534-afb2-64e898ff3fc8 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:20.613023 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-aafc5aae-5efd-4534-afb2-64e898ff3fc8 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:20.613757 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-aafc5aae-5efd-4534-afb2-64e898ff3fc8 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:20.614192 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-aafc5aae-5efd-4534-afb2-64e898ff3fc8 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:20.753505 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-aafc5aae-5efd-4534-afb2-64e898ff3fc8 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674d054767ff4eec993ca7fefdce3967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf521f7d98c641d4941eb041acf65405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:56:20.761151 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-aafc5aae-5efd-4534-afb2-64e898ff3fc8 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] 10.222.0.64 "GET /compute/v2.1/servers/40d79e6b-f23e-47aa-bb6c-04c1a6605256" status: 200 len: 1571 microversion: 2.1 time: 0.159953 Jul 19 15:56:20.761727 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 599/1148] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:56:20 2022] GET /compute/v2.1/servers/40d79e6b-f23e-47aa-bb6c-04c1a6605256 => generated 1571 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:56:20.850180 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-cfd8fc2d-0cd7-4f19-993b-cb78c36d4d89 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:56:20.852190 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-cfd8fc2d-0cd7-4f19-993b-cb78c36d4d89 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] [instance: 6a682004-8d98-4d3d-ad12-a1cf82bbaf1e] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:56:20.858769 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-cfd8fc2d-0cd7-4f19-993b-cb78c36d4d89 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:20.859226 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-cfd8fc2d-0cd7-4f19-993b-cb78c36d4d89 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:20.860000 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-cfd8fc2d-0cd7-4f19-993b-cb78c36d4d89 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:20.860438 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-cfd8fc2d-0cd7-4f19-993b-cb78c36d4d89 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:20.912126 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [req-b6553f3b-678b-4c99-b458-d3f6542862a0 req-52dfa147-a53a-406a-b826-11f9bd80985f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a682004-8d98-4d3d-ad12-a1cf82bbaf1e", "tag": "818b1333-97cf-4dc6-b490-98d025379610"}]} {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:56:20.922028 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [req-b6553f3b-678b-4c99-b458-d3f6542862a0 req-52dfa147-a53a-406a-b826-11f9bd80985f service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:20.922893 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [req-b6553f3b-678b-4c99-b458-d3f6542862a0 req-52dfa147-a53a-406a-b826-11f9bd80985f service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:20.935494 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.compute.server_external_events [req-b6553f3b-678b-4c99-b458-d3f6542862a0 req-52dfa147-a53a-406a-b826-11f9bd80985f service nova] Creating event network-changed:818b1333-97cf-4dc6-b490-98d025379610 for instance 6a682004-8d98-4d3d-ad12-a1cf82bbaf1e on hv-cinder-84902 Jul 19 15:56:20.940696 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [req-b6553f3b-678b-4c99-b458-d3f6542862a0 req-52dfa147-a53a-406a-b826-11f9bd80985f service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093893 Jul 19 15:56:20.941724 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 600/1149] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Jul 19 15:56:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:56:20.953162 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.objects.instance [None req-cfd8fc2d-0cd7-4f19-993b-cb78c36d4d89 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lazy-loading 'services' on Instance uuid 6a682004-8d98-4d3d-ad12-a1cf82bbaf1e {{(pid=129519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 15:56:21.033476 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-cfd8fc2d-0cd7-4f19-993b-cb78c36d4d89 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] 10.222.0.64 "DELETE /compute/v2.1/servers/6a682004-8d98-4d3d-ad12-a1cf82bbaf1e/os-volume_attachments/1a512744-7971-4776-9b81-8cb304eeb3d8" status: 202 len: 0 microversion: 2.1 time: 0.187943 Jul 19 15:56:21.034723 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 550/1150] 10.222.0.64 () {58 vars in 1415 bytes} [Tue Jul 19 15:56:20 2022] DELETE /compute/v2.1/servers/6a682004-8d98-4d3d-ad12-a1cf82bbaf1e/os-volume_attachments/1a512744-7971-4776-9b81-8cb304eeb3d8 => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 15:56:21.045763 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-5e6083e5-ed16-4a76-be58-50a92236a39e tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:56:21.047421 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-5e6083e5-ed16-4a76-be58-50a92236a39e tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] [instance: 6a682004-8d98-4d3d-ad12-a1cf82bbaf1e] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:56:21.056191 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-5e6083e5-ed16-4a76-be58-50a92236a39e tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:21.057319 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-5e6083e5-ed16-4a76-be58-50a92236a39e tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:21.058506 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-5e6083e5-ed16-4a76-be58-50a92236a39e tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:21.059102 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-5e6083e5-ed16-4a76-be58-50a92236a39e tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:21.106725 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-5e6083e5-ed16-4a76-be58-50a92236a39e tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] 10.222.0.64 "GET /compute/v2.1/servers/6a682004-8d98-4d3d-ad12-a1cf82bbaf1e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.066432 Jul 19 15:56:21.107302 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 601/1151] 10.222.0.64 () {58 vars in 1301 bytes} [Tue Jul 19 15:56:21 2022] GET /compute/v2.1/servers/6a682004-8d98-4d3d-ad12-a1cf82bbaf1e/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 15:56:21.778909 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-8bd995ab-b99c-488b-8f87-a5074ed8f440 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:56:21.779606 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-8bd995ab-b99c-488b-8f87-a5074ed8f440 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] [instance: 40d79e6b-f23e-47aa-bb6c-04c1a6605256] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:56:21.786061 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-8bd995ab-b99c-488b-8f87-a5074ed8f440 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:21.786481 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-8bd995ab-b99c-488b-8f87-a5074ed8f440 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:21.787248 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-8bd995ab-b99c-488b-8f87-a5074ed8f440 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:21.787691 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-8bd995ab-b99c-488b-8f87-a5074ed8f440 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:21.930701 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-8bd995ab-b99c-488b-8f87-a5074ed8f440 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674d054767ff4eec993ca7fefdce3967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf521f7d98c641d4941eb041acf65405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:56:21.938415 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-8bd995ab-b99c-488b-8f87-a5074ed8f440 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] 10.222.0.64 "GET /compute/v2.1/servers/40d79e6b-f23e-47aa-bb6c-04c1a6605256" status: 200 len: 1571 microversion: 2.1 time: 0.163901 Jul 19 15:56:21.938991 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 551/1152] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:56:21 2022] GET /compute/v2.1/servers/40d79e6b-f23e-47aa-bb6c-04c1a6605256 => generated 1571 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:56:22.119156 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-ee22116e-a64d-492e-8136-d56f862b8abf tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:56:22.120063 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-ee22116e-a64d-492e-8136-d56f862b8abf tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] [instance: 6a682004-8d98-4d3d-ad12-a1cf82bbaf1e] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:56:22.126525 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-ee22116e-a64d-492e-8136-d56f862b8abf tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:22.126965 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-ee22116e-a64d-492e-8136-d56f862b8abf tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:22.127710 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-ee22116e-a64d-492e-8136-d56f862b8abf tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:22.128166 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-ee22116e-a64d-492e-8136-d56f862b8abf tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:22.157244 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-ee22116e-a64d-492e-8136-d56f862b8abf tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] 10.222.0.64 "GET /compute/v2.1/servers/6a682004-8d98-4d3d-ad12-a1cf82bbaf1e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042639 Jul 19 15:56:22.157783 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 602/1153] 10.222.0.64 () {58 vars in 1301 bytes} [Tue Jul 19 15:56:22 2022] GET /compute/v2.1/servers/6a682004-8d98-4d3d-ad12-a1cf82bbaf1e/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jul 19 15:56:22.168570 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-cad3880b-c8c6-44a4-b203-c2ccaad5a714 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:56:22.169326 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-cad3880b-c8c6-44a4-b203-c2ccaad5a714 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] [instance: 6a682004-8d98-4d3d-ad12-a1cf82bbaf1e] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:56:22.175334 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-cad3880b-c8c6-44a4-b203-c2ccaad5a714 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:22.175788 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-cad3880b-c8c6-44a4-b203-c2ccaad5a714 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:22.176548 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-cad3880b-c8c6-44a4-b203-c2ccaad5a714 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:22.176987 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-cad3880b-c8c6-44a4-b203-c2ccaad5a714 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:22.194726 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG dbcounter [-] [129519] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=129519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:56:22.267255 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.wsgi [None req-cad3880b-c8c6-44a4-b203-c2ccaad5a714 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] HTTP exception thrown: Instance 6a682004-8d98-4d3d-ad12-a1cf82bbaf1e is not attached to volume 1a512744-7971-4776-9b81-8cb304eeb3d8 Jul 19 15:56:22.269627 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-cad3880b-c8c6-44a4-b203-c2ccaad5a714 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Request method failure captured: Jul 19 15:56:22.269627 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: request: DELETE /compute/v2.1/servers/6a682004-8d98-4d3d-ad12-a1cf82bbaf1e/os-volume_attachments/1a512744-7971-4776-9b81-8cb304eeb3d8 HTTP/1.1 Jul 19 15:56:22.269627 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Accept: application/json Jul 19 15:56:22.269627 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Accept-Encoding: identity Jul 19 15:56:22.269627 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Connection: close Jul 19 15:56:22.269627 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Content-Length: 0 Jul 19 15:56:22.269627 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Content-Type: application/json Jul 19 15:56:22.269627 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Host: 10.222.0.64 Jul 19 15:56:22.269627 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Openstack-System-Scope: None Jul 19 15:56:22.269627 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: User-Agent: python-urllib3/1.26.9 Jul 19 15:56:22.269627 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Auth-Token: gAAAAABi1tOsBfHQzHEL6-BRjoO11XNIgd4ixLWB5sc8ihFV1lRzqJ7d_PDd3Jtqflhb_MUT6qiePOu0abrbxd7vEj5QI6RBsSHXqabqsQapBaKqIrboCOjwyCOCgt6YvO2j_a4kIl-DuFNkXRKMEGpI4HBlj1CcY7a7h7MpudOwGUHXfESsMaM Jul 19 15:56:22.269627 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Domain-Id: None Jul 19 15:56:22.269627 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Domain-Name: None Jul 19 15:56:22.269627 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Identity-Status: Confirmed Jul 19 15:56:22.269627 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Is-Admin-Project: True Jul 19 15:56:22.269627 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Domain-Id: default Jul 19 15:56:22.269627 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Domain-Name: Default Jul 19 15:56:22.269627 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Id: 6a9e5f3b931d47b6bfb7938a89c2a37d Jul 19 15:56:22.269627 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Name: tempest-TestMinimumBasicScenario-2809320 Jul 19 15:56:22.269627 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Role: member,reader Jul 19 15:56:22.269627 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Roles: member,reader Jul 19 15:56:22.271441 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_6a9e5f3b931d47b6bfb7938a89c2a37d", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6a9e5f3b931d47b6bfb7938a89c2a37d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6a9e5f3b931d47b6bfb7938a89c2a37d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/6a9e5f3b931d47b6bfb7938a89c2a37d"}]}] Jul 19 15:56:22.271441 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Tenant: tempest-TestMinimumBasicScenario-2809320 Jul 19 15:56:22.271441 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Tenant-Id: 6a9e5f3b931d47b6bfb7938a89c2a37d Jul 19 15:56:22.271441 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2809320 Jul 19 15:56:22.271441 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User: tempest-TestMinimumBasicScenario-2809320-project Jul 19 15:56:22.271441 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Domain-Id: default Jul 19 15:56:22.271441 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Domain-Name: Default Jul 19 15:56:22.271441 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Id: 8a63627dc4624d9c8b73bcbfcc11fbf8 Jul 19 15:56:22.271441 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Name: tempest-TestMinimumBasicScenario-2809320-project Jul 19 15:56:22.271441 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: method: > Jul 19 15:56:22.271441 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: exception: Instance 6a682004-8d98-4d3d-ad12-a1cf82bbaf1e is not attached to volume 1a512744-7971-4776-9b81-8cb304eeb3d8 Jul 19 15:56:22.272449 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: action_args: {'server_id': '6a682004-8d98-4d3d-ad12-a1cf82bbaf1e', 'id': '1a512744-7971-4776-9b81-8cb304eeb3d8'} Jul 19 15:56:22.272449 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:56:22.272449 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:56:22.272449 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 19 15:56:22.272449 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 19 15:56:22.272449 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 19 15:56:22.272449 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 19 15:56:22.272449 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 19 15:56:22.272449 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 19 15:56:22.272449 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 1a512744-7971-4776-9b81-8cb304eeb3d8. Jul 19 15:56:22.272449 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:56:22.272449 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:56:22.272449 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:56:22.272449 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:56:22.272449 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:56:22.272449 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:56:22.272449 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:56:22.272449 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:56:22.272449 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:56:22.274689 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:56:22.274689 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 19 15:56:22.274689 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 19 15:56:22.274689 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a682004-8d98-4d3d-ad12-a1cf82bbaf1e is not attached to volume 1a512744-7971-4776-9b81-8cb304eeb3d8 Jul 19 15:56:22.274689 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:56:22.274689 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:56:22.274689 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:56:22.274689 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:56:22.274689 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:56:22.274689 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:56:22.274689 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:56:22.274689 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:56:22.274689 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a682004-8d98-4d3d-ad12-a1cf82bbaf1e is not attached to volume 1a512744-7971-4776-9b81-8cb304eeb3d8 Jul 19 15:56:22.274689 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:56:22.274689 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-cad3880b-c8c6-44a4-b203-c2ccaad5a714 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Returning 404 to user: Instance 6a682004-8d98-4d3d-ad12-a1cf82bbaf1e is not attached to volume 1a512744-7971-4776-9b81-8cb304eeb3d8 {{(pid=129519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:56:22.276034 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-cad3880b-c8c6-44a4-b203-c2ccaad5a714 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] 10.222.0.64 "DELETE /compute/v2.1/servers/6a682004-8d98-4d3d-ad12-a1cf82bbaf1e/os-volume_attachments/1a512744-7971-4776-9b81-8cb304eeb3d8" status: 404 len: 154 microversion: 2.1 time: 0.107429 Jul 19 15:56:22.276034 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 552/1154] 10.222.0.64 () {58 vars in 1415 bytes} [Tue Jul 19 15:56:22 2022] DELETE /compute/v2.1/servers/6a682004-8d98-4d3d-ad12-a1cf82bbaf1e/os-volume_attachments/1a512744-7971-4776-9b81-8cb304eeb3d8 => generated 154 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 15:56:22.956076 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-696d4503-fac0-4594-a517-651d49a02013 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:56:22.956600 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-696d4503-fac0-4594-a517-651d49a02013 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] [instance: 40d79e6b-f23e-47aa-bb6c-04c1a6605256] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:56:22.966396 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-696d4503-fac0-4594-a517-651d49a02013 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:22.966850 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-696d4503-fac0-4594-a517-651d49a02013 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:22.968487 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-696d4503-fac0-4594-a517-651d49a02013 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:22.968920 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-696d4503-fac0-4594-a517-651d49a02013 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:23.106623 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-696d4503-fac0-4594-a517-651d49a02013 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674d054767ff4eec993ca7fefdce3967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf521f7d98c641d4941eb041acf65405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:56:23.115162 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-696d4503-fac0-4594-a517-651d49a02013 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] 10.222.0.64 "GET /compute/v2.1/servers/40d79e6b-f23e-47aa-bb6c-04c1a6605256" status: 200 len: 1571 microversion: 2.1 time: 0.163044 Jul 19 15:56:23.115741 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 603/1155] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:56:22 2022] GET /compute/v2.1/servers/40d79e6b-f23e-47aa-bb6c-04c1a6605256 => generated 1571 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:56:23.410637 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-498d5d7b-aa5e-4982-b089-649ab8e7370e tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:56:23.411125 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-498d5d7b-aa5e-4982-b089-649ab8e7370e tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] [instance: 6a682004-8d98-4d3d-ad12-a1cf82bbaf1e] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:56:23.418787 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-498d5d7b-aa5e-4982-b089-649ab8e7370e tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:23.419663 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-498d5d7b-aa5e-4982-b089-649ab8e7370e tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:23.420432 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-498d5d7b-aa5e-4982-b089-649ab8e7370e tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:23.420900 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-498d5d7b-aa5e-4982-b089-649ab8e7370e tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:23.446493 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-498d5d7b-aa5e-4982-b089-649ab8e7370e tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] [instance: 6a682004-8d98-4d3d-ad12-a1cf82bbaf1e] Going to try to terminate instance {{(pid=129519) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 15:56:23.521209 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-498d5d7b-aa5e-4982-b089-649ab8e7370e tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] 10.222.0.64 "DELETE /compute/v2.1/servers/6a682004-8d98-4d3d-ad12-a1cf82bbaf1e" status: 204 len: 0 microversion: 2.1 time: 0.114109 Jul 19 15:56:23.526007 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 553/1156] 10.222.0.64 () {58 vars in 1238 bytes} [Tue Jul 19 15:56:23 2022] DELETE /compute/v2.1/servers/6a682004-8d98-4d3d-ad12-a1cf82bbaf1e => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 15:56:23.531038 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-8bf27ffb-47b9-40dd-b9b9-eee6f3687606 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:56:23.531652 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-8bf27ffb-47b9-40dd-b9b9-eee6f3687606 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] [instance: 6a682004-8d98-4d3d-ad12-a1cf82bbaf1e] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:56:23.537752 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-8bf27ffb-47b9-40dd-b9b9-eee6f3687606 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:23.538202 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-8bf27ffb-47b9-40dd-b9b9-eee6f3687606 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:23.539291 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-8bf27ffb-47b9-40dd-b9b9-eee6f3687606 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:23.539734 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-8bf27ffb-47b9-40dd-b9b9-eee6f3687606 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:23.673176 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-8bf27ffb-47b9-40dd-b9b9-eee6f3687606 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a63627dc4624d9c8b73bcbfcc11fbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9e5f3b931d47b6bfb7938a89c2a37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:56:23.681476 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-8bf27ffb-47b9-40dd-b9b9-eee6f3687606 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] 10.222.0.64 "GET /compute/v2.1/servers/6a682004-8d98-4d3d-ad12-a1cf82bbaf1e" status: 200 len: 1553 microversion: 2.1 time: 0.154291 Jul 19 15:56:23.682307 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 604/1157] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:56:23 2022] GET /compute/v2.1/servers/6a682004-8d98-4d3d-ad12-a1cf82bbaf1e => generated 1553 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 19 15:56:24.132878 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-a278c9e4-220a-422a-940a-5c58199a1c2b tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:56:24.133599 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-a278c9e4-220a-422a-940a-5c58199a1c2b tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] [instance: 40d79e6b-f23e-47aa-bb6c-04c1a6605256] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:56:24.139554 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-a278c9e4-220a-422a-940a-5c58199a1c2b tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:24.140000 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-a278c9e4-220a-422a-940a-5c58199a1c2b tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:24.140748 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-a278c9e4-220a-422a-940a-5c58199a1c2b tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:24.141177 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-a278c9e4-220a-422a-940a-5c58199a1c2b tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:24.284022 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-a278c9e4-220a-422a-940a-5c58199a1c2b tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674d054767ff4eec993ca7fefdce3967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf521f7d98c641d4941eb041acf65405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:56:24.291553 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-a278c9e4-220a-422a-940a-5c58199a1c2b tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] 10.222.0.64 "GET /compute/v2.1/servers/40d79e6b-f23e-47aa-bb6c-04c1a6605256" status: 200 len: 1571 microversion: 2.1 time: 0.163643 Jul 19 15:56:24.292107 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 554/1158] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:56:24 2022] GET /compute/v2.1/servers/40d79e6b-f23e-47aa-bb6c-04c1a6605256 => generated 1571 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:56:24.699613 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-4e61a48f-0e85-4337-87b3-f3f2dfcdb1b7 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:56:24.700227 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-4e61a48f-0e85-4337-87b3-f3f2dfcdb1b7 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] [instance: 6a682004-8d98-4d3d-ad12-a1cf82bbaf1e] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:56:24.706752 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-4e61a48f-0e85-4337-87b3-f3f2dfcdb1b7 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:24.707203 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-4e61a48f-0e85-4337-87b3-f3f2dfcdb1b7 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:24.707964 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-4e61a48f-0e85-4337-87b3-f3f2dfcdb1b7 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:24.708398 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-4e61a48f-0e85-4337-87b3-f3f2dfcdb1b7 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:24.835335 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-4e61a48f-0e85-4337-87b3-f3f2dfcdb1b7 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a63627dc4624d9c8b73bcbfcc11fbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9e5f3b931d47b6bfb7938a89c2a37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:56:24.842991 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-4e61a48f-0e85-4337-87b3-f3f2dfcdb1b7 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] 10.222.0.64 "GET /compute/v2.1/servers/6a682004-8d98-4d3d-ad12-a1cf82bbaf1e" status: 200 len: 1553 microversion: 2.1 time: 0.147242 Jul 19 15:56:24.843564 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 605/1159] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:56:24 2022] GET /compute/v2.1/servers/6a682004-8d98-4d3d-ad12-a1cf82bbaf1e => generated 1553 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:56:25.309081 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-145419d4-8f4a-402f-ac73-2863d3627373 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:56:25.309646 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-145419d4-8f4a-402f-ac73-2863d3627373 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] [instance: 40d79e6b-f23e-47aa-bb6c-04c1a6605256] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:56:25.316140 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-145419d4-8f4a-402f-ac73-2863d3627373 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:25.316574 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-145419d4-8f4a-402f-ac73-2863d3627373 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:25.317335 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-145419d4-8f4a-402f-ac73-2863d3627373 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:25.317774 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-145419d4-8f4a-402f-ac73-2863d3627373 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:25.455063 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-145419d4-8f4a-402f-ac73-2863d3627373 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674d054767ff4eec993ca7fefdce3967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf521f7d98c641d4941eb041acf65405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:56:25.464810 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-145419d4-8f4a-402f-ac73-2863d3627373 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] 10.222.0.64 "GET /compute/v2.1/servers/40d79e6b-f23e-47aa-bb6c-04c1a6605256" status: 200 len: 1571 microversion: 2.1 time: 0.159567 Jul 19 15:56:25.466071 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 555/1160] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:56:25 2022] GET /compute/v2.1/servers/40d79e6b-f23e-47aa-bb6c-04c1a6605256 => generated 1571 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:56:25.645290 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [req-22f5fba4-195d-4b6b-aa41-603bbe83651d req-fc872a2a-681e-4422-98e4-908979222777 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40d79e6b-f23e-47aa-bb6c-04c1a6605256", "name": "network-vif-plugged", "status": "completed", "tag": "1afaa31f-2b36-4dde-a958-b15bf3c12a62"}]} {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:56:25.654860 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [req-22f5fba4-195d-4b6b-aa41-603bbe83651d req-fc872a2a-681e-4422-98e4-908979222777 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:25.655422 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [req-22f5fba4-195d-4b6b-aa41-603bbe83651d req-fc872a2a-681e-4422-98e4-908979222777 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:25.661166 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG dbcounter [-] [129520] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:56:25.670979 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.compute.server_external_events [req-22f5fba4-195d-4b6b-aa41-603bbe83651d req-fc872a2a-681e-4422-98e4-908979222777 service nova] Creating event network-vif-plugged:1afaa31f-2b36-4dde-a958-b15bf3c12a62 for instance 40d79e6b-f23e-47aa-bb6c-04c1a6605256 on hv-cinder-84902 Jul 19 15:56:25.678658 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [req-22f5fba4-195d-4b6b-aa41-603bbe83651d req-fc872a2a-681e-4422-98e4-908979222777 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037356 Jul 19 15:56:25.679451 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 606/1161] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Jul 19 15:56:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:56:25.860413 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-1d6571d3-b7ee-4b7b-8811-843fea57a5cd tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:56:25.861044 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-1d6571d3-b7ee-4b7b-8811-843fea57a5cd tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] [instance: 6a682004-8d98-4d3d-ad12-a1cf82bbaf1e] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:56:25.867208 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-1d6571d3-b7ee-4b7b-8811-843fea57a5cd tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:25.867648 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-1d6571d3-b7ee-4b7b-8811-843fea57a5cd tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:25.868463 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-1d6571d3-b7ee-4b7b-8811-843fea57a5cd tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:25.868896 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-1d6571d3-b7ee-4b7b-8811-843fea57a5cd tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:25.881291 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [req-364c2204-eff7-4320-807f-640c1d839a18 req-5eec081d-e7a7-496e-8e73-d040a6c9a3a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a682004-8d98-4d3d-ad12-a1cf82bbaf1e", "name": "network-vif-deleted", "tag": "818b1333-97cf-4dc6-b490-98d025379610"}]} {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:56:25.893361 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [req-364c2204-eff7-4320-807f-640c1d839a18 req-5eec081d-e7a7-496e-8e73-d040a6c9a3a4 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:25.893797 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [req-364c2204-eff7-4320-807f-640c1d839a18 req-5eec081d-e7a7-496e-8e73-d040a6c9a3a4 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:25.907296 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.compute.server_external_events [req-364c2204-eff7-4320-807f-640c1d839a18 req-5eec081d-e7a7-496e-8e73-d040a6c9a3a4 service nova] Creating event network-vif-deleted:818b1333-97cf-4dc6-b490-98d025379610 for instance 6a682004-8d98-4d3d-ad12-a1cf82bbaf1e on hv-cinder-84902 Jul 19 15:56:25.912897 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [req-364c2204-eff7-4320-807f-640c1d839a18 req-5eec081d-e7a7-496e-8e73-d040a6c9a3a4 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037110 Jul 19 15:56:25.914347 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 607/1162] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Jul 19 15:56:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 19 15:56:25.950067 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-1d6571d3-b7ee-4b7b-8811-843fea57a5cd tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8a63627dc4624d9c8b73bcbfcc11fbf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6a9e5f3b931d47b6bfb7938a89c2a37d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:56:25.957975 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-1d6571d3-b7ee-4b7b-8811-843fea57a5cd tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] 10.222.0.64 "GET /compute/v2.1/servers/6a682004-8d98-4d3d-ad12-a1cf82bbaf1e" status: 200 len: 1511 microversion: 2.1 time: 0.101550 Jul 19 15:56:25.958548 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 556/1163] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:56:25 2022] GET /compute/v2.1/servers/6a682004-8d98-4d3d-ad12-a1cf82bbaf1e => generated 1511 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:56:26.482526 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-6ce7fd78-7e3f-4205-ac03-4889eed80b75 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:56:26.483121 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-6ce7fd78-7e3f-4205-ac03-4889eed80b75 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] [instance: 40d79e6b-f23e-47aa-bb6c-04c1a6605256] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:56:26.489207 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-6ce7fd78-7e3f-4205-ac03-4889eed80b75 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:26.489645 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-6ce7fd78-7e3f-4205-ac03-4889eed80b75 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:26.490400 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-6ce7fd78-7e3f-4205-ac03-4889eed80b75 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:26.490827 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-6ce7fd78-7e3f-4205-ac03-4889eed80b75 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:26.620656 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-6ce7fd78-7e3f-4205-ac03-4889eed80b75 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674d054767ff4eec993ca7fefdce3967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf521f7d98c641d4941eb041acf65405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:56:26.628646 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-6ce7fd78-7e3f-4205-ac03-4889eed80b75 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] 10.222.0.64 "GET /compute/v2.1/servers/40d79e6b-f23e-47aa-bb6c-04c1a6605256" status: 200 len: 1558 microversion: 2.1 time: 0.150013 Jul 19 15:56:26.629222 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 608/1164] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:56:26 2022] GET /compute/v2.1/servers/40d79e6b-f23e-47aa-bb6c-04c1a6605256 => generated 1558 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:56:26.975737 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-7c73f40e-3d6c-4165-af25-001ee5e3aaca tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:56:26.977307 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-7c73f40e-3d6c-4165-af25-001ee5e3aaca tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] [instance: 6a682004-8d98-4d3d-ad12-a1cf82bbaf1e] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:56:26.983929 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-7c73f40e-3d6c-4165-af25-001ee5e3aaca tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:26.984375 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-7c73f40e-3d6c-4165-af25-001ee5e3aaca tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:26.985141 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-7c73f40e-3d6c-4165-af25-001ee5e3aaca tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:56:26.985576 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-7c73f40e-3d6c-4165-af25-001ee5e3aaca tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:56:26.999403 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.wsgi [None req-7c73f40e-3d6c-4165-af25-001ee5e3aaca tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] HTTP exception thrown: Instance 6a682004-8d98-4d3d-ad12-a1cf82bbaf1e could not be found. Jul 19 15:56:27.001029 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-7c73f40e-3d6c-4165-af25-001ee5e3aaca tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Request method failure captured: Jul 19 15:56:27.001029 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: request: GET /compute/v2.1/servers/6a682004-8d98-4d3d-ad12-a1cf82bbaf1e HTTP/1.1 Jul 19 15:56:27.001029 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Accept: application/json Jul 19 15:56:27.001029 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Accept-Encoding: identity Jul 19 15:56:27.001029 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Connection: close Jul 19 15:56:27.001029 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Content-Length: 0 Jul 19 15:56:27.001029 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Content-Type: application/json Jul 19 15:56:27.001029 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Host: 10.222.0.64 Jul 19 15:56:27.001029 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Openstack-System-Scope: None Jul 19 15:56:27.001029 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: User-Agent: python-urllib3/1.26.9 Jul 19 15:56:27.001029 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Auth-Token: gAAAAABi1tOsBfHQzHEL6-BRjoO11XNIgd4ixLWB5sc8ihFV1lRzqJ7d_PDd3Jtqflhb_MUT6qiePOu0abrbxd7vEj5QI6RBsSHXqabqsQapBaKqIrboCOjwyCOCgt6YvO2j_a4kIl-DuFNkXRKMEGpI4HBlj1CcY7a7h7MpudOwGUHXfESsMaM Jul 19 15:56:27.001029 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Domain-Id: None Jul 19 15:56:27.001029 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Domain-Name: None Jul 19 15:56:27.001029 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Identity-Status: Confirmed Jul 19 15:56:27.001029 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Is-Admin-Project: True Jul 19 15:56:27.001029 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Domain-Id: default Jul 19 15:56:27.001029 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Domain-Name: Default Jul 19 15:56:27.001029 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Id: 6a9e5f3b931d47b6bfb7938a89c2a37d Jul 19 15:56:27.001029 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Project-Name: tempest-TestMinimumBasicScenario-2809320 Jul 19 15:56:27.001029 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Role: member,reader Jul 19 15:56:27.001029 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Roles: member,reader Jul 19 15:56:27.002685 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_6a9e5f3b931d47b6bfb7938a89c2a37d", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6a9e5f3b931d47b6bfb7938a89c2a37d"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/6a9e5f3b931d47b6bfb7938a89c2a37d"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/6a9e5f3b931d47b6bfb7938a89c2a37d"}]}] Jul 19 15:56:27.002685 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Tenant: tempest-TestMinimumBasicScenario-2809320 Jul 19 15:56:27.002685 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Tenant-Id: 6a9e5f3b931d47b6bfb7938a89c2a37d Jul 19 15:56:27.002685 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-Tenant-Name: tempest-TestMinimumBasicScenario-2809320 Jul 19 15:56:27.002685 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User: tempest-TestMinimumBasicScenario-2809320-project Jul 19 15:56:27.002685 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Domain-Id: default Jul 19 15:56:27.002685 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Domain-Name: Default Jul 19 15:56:27.002685 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Id: 8a63627dc4624d9c8b73bcbfcc11fbf8 Jul 19 15:56:27.002685 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: X-User-Name: tempest-TestMinimumBasicScenario-2809320-project Jul 19 15:56:27.002685 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: method: > Jul 19 15:56:27.002685 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: exception: Instance 6a682004-8d98-4d3d-ad12-a1cf82bbaf1e could not be found. Jul 19 15:56:27.002685 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: action_args: {'id': '6a682004-8d98-4d3d-ad12-a1cf82bbaf1e'} Jul 19 15:56:27.004456 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:56:27.004456 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:56:27.004456 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 15:56:27.004456 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 15:56:27.004456 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 15:56:27.004456 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 15:56:27.004456 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 15:56:27.004456 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 15:56:27.004456 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 15:56:27.004456 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 15:56:27.004456 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a682004-8d98-4d3d-ad12-a1cf82bbaf1e could not be found. Jul 19 15:56:27.004456 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:56:27.004456 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:56:27.004456 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:56:27.004456 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:56:27.004456 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:56:27.004456 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:56:27.004456 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:56:27.004456 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:56:27.004456 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:56:27.006004 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:56:27.006004 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 15:56:27.006004 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 15:56:27.006004 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 15:56:27.006004 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 15:56:27.006004 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 15:56:27.006004 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 15:56:27.006004 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a682004-8d98-4d3d-ad12-a1cf82bbaf1e could not be found. Jul 19 15:56:27.006004 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:56:27.006004 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:56:27.006004 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:56:27.006004 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:56:27.006004 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:56:27.006004 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:56:27.006004 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:56:27.006004 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:56:27.006004 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a682004-8d98-4d3d-ad12-a1cf82bbaf1e could not be found. Jul 19 15:56:27.006004 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: ERROR nova.api.openstack.wsgi Jul 19 15:56:27.007693 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-7c73f40e-3d6c-4165-af25-001ee5e3aaca tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Returning 404 to user: Instance 6a682004-8d98-4d3d-ad12-a1cf82bbaf1e could not be found. {{(pid=129519) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:56:27.007693 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-7c73f40e-3d6c-4165-af25-001ee5e3aaca tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] 10.222.0.64 "GET /compute/v2.1/servers/6a682004-8d98-4d3d-ad12-a1cf82bbaf1e" status: 404 len: 111 microversion: 2.1 time: 0.030638 Jul 19 15:56:27.007693 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 557/1165] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:56:26 2022] GET /compute/v2.1/servers/6a682004-8d98-4d3d-ad12-a1cf82bbaf1e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 15:56:27.011088 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-02e63726-b1d9-42cd-b479-f67170c58dc8 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] Calling method '.version_select at 0x7fb8a65c1c10>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:56:27.014190 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR oslo.messaging._drivers.impl_rabbit [None req-02e63726-b1d9-42cd-b479-f67170c58dc8 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] [a7038b73-30ba-4a19-9ac9-7bf7627b9257] AMQP server on 10.222.0.64:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 19 15:56:28.021810 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO oslo.messaging._drivers.impl_rabbit [None req-02e63726-b1d9-42cd-b479-f67170c58dc8 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] [a7038b73-30ba-4a19-9ac9-7bf7627b9257] Reconnected to AMQP server on 10.222.0.64:5672 via [amqp] client with port 36122. Jul 19 15:56:28.040020 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-02e63726-b1d9-42cd-b479-f67170c58dc8 tempest-TestMinimumBasicScenario-2809320 tempest-TestMinimumBasicScenario-2809320-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1320606493" status: 202 len: 0 microversion: 2.1 time: 1.032680 Jul 19 15:56:28.040592 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 609/1166] 10.222.0.64 () {58 vars in 1271 bytes} [Tue Jul 19 15:56:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1320606493 => generated 0 bytes in 1034 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 15:57:43.410734 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG dbcounter [-] [129519] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=1 {{(pid=129519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:57:43.411561 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG dbcounter [-] [129519] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=129519) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:57:43.413574 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG dbcounter [-] [129520] Writing DB stats nova_cell1:SELECT=8 {{(pid=129520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:57:43.414369 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG dbcounter [-] [129520] Writing DB stats nova_api:SELECT=45,nova_api:DELETE=1 {{(pid=129520) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 19 15:57:43.416874 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-bd2046a0-5b67-45e1-a97a-7302a68c81d9 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:57:43.417556 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-bd2046a0-5b67-45e1-a97a-7302a68c81d9 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] [instance: 40d79e6b-f23e-47aa-bb6c-04c1a6605256] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:57:43.419764 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [req-8ba83628-110d-4192-92ee-c54515c3af5a req-75762d91-2580-4307-8b04-5b0c4d8466a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40d79e6b-f23e-47aa-bb6c-04c1a6605256", "tag": "1afaa31f-2b36-4dde-a958-b15bf3c12a62"}]} {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:57:43.426196 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-bd2046a0-5b67-45e1-a97a-7302a68c81d9 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:43.426727 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-bd2046a0-5b67-45e1-a97a-7302a68c81d9 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:43.427603 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-bd2046a0-5b67-45e1-a97a-7302a68c81d9 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:43.428068 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-bd2046a0-5b67-45e1-a97a-7302a68c81d9 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:43.430233 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [req-8ba83628-110d-4192-92ee-c54515c3af5a req-75762d91-2580-4307-8b04-5b0c4d8466a0 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:43.431759 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [req-8ba83628-110d-4192-92ee-c54515c3af5a req-75762d91-2580-4307-8b04-5b0c4d8466a0 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:43.443773 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.compute.server_external_events [req-8ba83628-110d-4192-92ee-c54515c3af5a req-75762d91-2580-4307-8b04-5b0c4d8466a0 service nova] Creating event network-changed:1afaa31f-2b36-4dde-a958-b15bf3c12a62 for instance 40d79e6b-f23e-47aa-bb6c-04c1a6605256 on hv-cinder-84902 Jul 19 15:57:43.449110 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [req-8ba83628-110d-4192-92ee-c54515c3af5a req-75762d91-2580-4307-8b04-5b0c4d8466a0 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037523 Jul 19 15:57:43.450112 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 610/1167] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Jul 19 15:57:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:57:43.457161 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-bd2046a0-5b67-45e1-a97a-7302a68c81d9 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] [instance: 40d79e6b-f23e-47aa-bb6c-04c1a6605256] Going to try to terminate instance {{(pid=129519) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 19 15:57:43.542150 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-bd2046a0-5b67-45e1-a97a-7302a68c81d9 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] 10.222.0.64 "DELETE /compute/v2.1/servers/40d79e6b-f23e-47aa-bb6c-04c1a6605256" status: 204 len: 0 microversion: 2.1 time: 0.132857 Jul 19 15:57:43.543272 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 558/1168] 10.222.0.64 () {58 vars in 1238 bytes} [Tue Jul 19 15:57:43 2022] DELETE /compute/v2.1/servers/40d79e6b-f23e-47aa-bb6c-04c1a6605256 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 19 15:57:43.552146 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-2f528732-a534-4a81-9d34-9f4b119290a2 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:57:43.553086 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-2f528732-a534-4a81-9d34-9f4b119290a2 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] [instance: 40d79e6b-f23e-47aa-bb6c-04c1a6605256] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:57:43.559759 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-2f528732-a534-4a81-9d34-9f4b119290a2 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:43.560278 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-2f528732-a534-4a81-9d34-9f4b119290a2 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:43.561237 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-2f528732-a534-4a81-9d34-9f4b119290a2 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:43.561753 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-2f528732-a534-4a81-9d34-9f4b119290a2 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:43.742607 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.policy [None req-2f528732-a534-4a81-9d34-9f4b119290a2 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674d054767ff4eec993ca7fefdce3967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf521f7d98c641d4941eb041acf65405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129520) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:57:43.750567 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-2f528732-a534-4a81-9d34-9f4b119290a2 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] 10.222.0.64 "GET /compute/v2.1/servers/40d79e6b-f23e-47aa-bb6c-04c1a6605256" status: 200 len: 1564 microversion: 2.1 time: 0.202669 Jul 19 15:57:43.751141 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 611/1169] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:57:43 2022] GET /compute/v2.1/servers/40d79e6b-f23e-47aa-bb6c-04c1a6605256 => generated 1564 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:57:44.771698 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-c8ba4c20-86fd-4b03-96f8-532f1e0a25c1 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:57:44.772519 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-c8ba4c20-86fd-4b03-96f8-532f1e0a25c1 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] [instance: 40d79e6b-f23e-47aa-bb6c-04c1a6605256] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:57:44.779996 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-c8ba4c20-86fd-4b03-96f8-532f1e0a25c1 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:44.780444 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-c8ba4c20-86fd-4b03-96f8-532f1e0a25c1 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:44.781219 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-c8ba4c20-86fd-4b03-96f8-532f1e0a25c1 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:44.781670 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-c8ba4c20-86fd-4b03-96f8-532f1e0a25c1 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:44.921890 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-c8ba4c20-86fd-4b03-96f8-532f1e0a25c1 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674d054767ff4eec993ca7fefdce3967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf521f7d98c641d4941eb041acf65405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:57:44.929477 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-c8ba4c20-86fd-4b03-96f8-532f1e0a25c1 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] 10.222.0.64 "GET /compute/v2.1/servers/40d79e6b-f23e-47aa-bb6c-04c1a6605256" status: 200 len: 1564 microversion: 2.1 time: 0.162225 Jul 19 15:57:44.930031 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 559/1170] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:57:44 2022] GET /compute/v2.1/servers/40d79e6b-f23e-47aa-bb6c-04c1a6605256 => generated 1564 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:57:45.481006 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [req-b4b3ccac-1f4f-4248-b144-636052a1c5f5 req-4de368d3-7607-4d03-89a4-42c4bd7b12c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40d79e6b-f23e-47aa-bb6c-04c1a6605256", "name": "network-vif-deleted", "tag": "1afaa31f-2b36-4dde-a958-b15bf3c12a62"}]} {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 19 15:57:45.491965 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [req-b4b3ccac-1f4f-4248-b144-636052a1c5f5 req-4de368d3-7607-4d03-89a4-42c4bd7b12c2 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:45.492446 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [req-b4b3ccac-1f4f-4248-b144-636052a1c5f5 req-4de368d3-7607-4d03-89a4-42c4bd7b12c2 service nova] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:45.504081 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.compute.server_external_events [req-b4b3ccac-1f4f-4248-b144-636052a1c5f5 req-4de368d3-7607-4d03-89a4-42c4bd7b12c2 service nova] Creating event network-vif-deleted:1afaa31f-2b36-4dde-a958-b15bf3c12a62 for instance 40d79e6b-f23e-47aa-bb6c-04c1a6605256 on hv-cinder-84902 Jul 19 15:57:45.509082 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [req-b4b3ccac-1f4f-4248-b144-636052a1c5f5 req-4de368d3-7607-4d03-89a4-42c4bd7b12c2 service nova] 10.222.0.64 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032446 Jul 19 15:57:45.509707 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 612/1171] 10.222.0.64 () {64 vars in 1317 bytes} [Tue Jul 19 15:57:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 19 15:57:45.947128 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-49df1fd1-d1a5-46f5-9faf-a29387dbce02 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Calling method '>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:57:45.947756 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.compute.api [None req-49df1fd1-d1a5-46f5-9faf-a29387dbce02 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] [instance: 40d79e6b-f23e-47aa-bb6c-04c1a6605256] Fetching instance by UUID {{(pid=129519) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:57:45.954347 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-49df1fd1-d1a5-46f5-9faf-a29387dbce02 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:45.954869 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-49df1fd1-d1a5-46f5-9faf-a29387dbce02 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:45.955647 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-49df1fd1-d1a5-46f5-9faf-a29387dbce02 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:45.956089 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-49df1fd1-d1a5-46f5-9faf-a29387dbce02 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:45.988586 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-49df1fd1-d1a5-46f5-9faf-a29387dbce02 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:45.989040 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG oslo_concurrency.lockutils [None req-49df1fd1-d1a5-46f5-9faf-a29387dbce02 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=129519) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:45.989491 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.objects.instance [None req-49df1fd1-d1a5-46f5-9faf-a29387dbce02 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lazy-loading 'fault' on Instance uuid 40d79e6b-f23e-47aa-bb6c-04c1a6605256 {{(pid=129519) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 19 15:57:46.033152 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.policy [None req-49df1fd1-d1a5-46f5-9faf-a29387dbce02 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '674d054767ff4eec993ca7fefdce3967', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cf521f7d98c641d4941eb041acf65405', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=129519) authorize /opt/stack/nova/nova/policy.py:199}} Jul 19 15:57:46.041375 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-49df1fd1-d1a5-46f5-9faf-a29387dbce02 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] 10.222.0.64 "GET /compute/v2.1/servers/40d79e6b-f23e-47aa-bb6c-04c1a6605256" status: 200 len: 1222 microversion: 2.1 time: 0.098539 Jul 19 15:57:46.042026 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 560/1172] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:57:45 2022] GET /compute/v2.1/servers/40d79e6b-f23e-47aa-bb6c-04c1a6605256 => generated 1222 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 19 15:57:47.061740 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-e3b00d0d-7a67-4b4c-9fd0-b213cb870802 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Calling method '>' {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:57:47.062349 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.compute.api [None req-e3b00d0d-7a67-4b4c-9fd0-b213cb870802 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] [instance: 40d79e6b-f23e-47aa-bb6c-04c1a6605256] Fetching instance by UUID {{(pid=129520) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 19 15:57:47.068592 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-e3b00d0d-7a67-4b4c-9fd0-b213cb870802 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:47.069038 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-e3b00d0d-7a67-4b4c-9fd0-b213cb870802 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:47.069798 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-e3b00d0d-7a67-4b4c-9fd0-b213cb870802 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 19 15:57:47.070233 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG oslo_concurrency.lockutils [None req-e3b00d0d-7a67-4b4c-9fd0-b213cb870802 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Lock "daf180c5-09be-4981-8daf-984991910d73" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=129520) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 19 15:57:47.084724 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.wsgi [None req-e3b00d0d-7a67-4b4c-9fd0-b213cb870802 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] HTTP exception thrown: Instance 40d79e6b-f23e-47aa-bb6c-04c1a6605256 could not be found. Jul 19 15:57:47.086315 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-e3b00d0d-7a67-4b4c-9fd0-b213cb870802 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Request method failure captured: Jul 19 15:57:47.086315 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: request: GET /compute/v2.1/servers/40d79e6b-f23e-47aa-bb6c-04c1a6605256 HTTP/1.1 Jul 19 15:57:47.086315 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Accept: application/json Jul 19 15:57:47.086315 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Accept-Encoding: identity Jul 19 15:57:47.086315 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Connection: close Jul 19 15:57:47.086315 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Content-Length: 0 Jul 19 15:57:47.086315 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Content-Type: application/json Jul 19 15:57:47.086315 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Host: 10.222.0.64 Jul 19 15:57:47.086315 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Openstack-System-Scope: None Jul 19 15:57:47.086315 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: User-Agent: python-urllib3/1.26.9 Jul 19 15:57:47.086315 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Auth-Token: gAAAAABi1tNy9nJB5YnwhMP-BBKLYuFepxYXPwQlnWM8DQcQA26GTzjp90jFQYBvwBHB4oJUi5C5Ng9QyZ6G4zqPs8O2niWiT_IlErd-zNQn-9UxUDdp3W8NEy_7xbpuoHPHOzdM6MXqQd3h0YddY5_vbTm1aNNryCRRcsiv8ipxB2GxfABy0xM Jul 19 15:57:47.086315 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Domain-Id: None Jul 19 15:57:47.086315 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Domain-Name: None Jul 19 15:57:47.086315 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Identity-Status: Confirmed Jul 19 15:57:47.086315 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Is-Admin-Project: True Jul 19 15:57:47.086315 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Project-Domain-Id: default Jul 19 15:57:47.086315 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Project-Domain-Name: Default Jul 19 15:57:47.086315 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Project-Id: cf521f7d98c641d4941eb041acf65405 Jul 19 15:57:47.086315 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Project-Name: tempest-TestShelveInstance-513174704 Jul 19 15:57:47.086315 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Role: member,reader Jul 19 15:57:47.086315 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Roles: member,reader Jul 19 15:57:47.088683 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64:8080/v1/AUTH_cf521f7d98c641d4941eb041acf65405", "adminURL": "http://10.222.0.64:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/cf521f7d98c641d4941eb041acf65405"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/volume/v3/cf521f7d98c641d4941eb041acf65405"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.64/compute/v2/cf521f7d98c641d4941eb041acf65405"}]}] Jul 19 15:57:47.088683 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Tenant: tempest-TestShelveInstance-513174704 Jul 19 15:57:47.088683 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Tenant-Id: cf521f7d98c641d4941eb041acf65405 Jul 19 15:57:47.088683 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-Tenant-Name: tempest-TestShelveInstance-513174704 Jul 19 15:57:47.088683 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User: tempest-TestShelveInstance-513174704-project Jul 19 15:57:47.088683 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User-Domain-Id: default Jul 19 15:57:47.088683 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User-Domain-Name: Default Jul 19 15:57:47.088683 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User-Id: 674d054767ff4eec993ca7fefdce3967 Jul 19 15:57:47.088683 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: X-User-Name: tempest-TestShelveInstance-513174704-project Jul 19 15:57:47.088683 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: method: > Jul 19 15:57:47.088683 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: exception: Instance 40d79e6b-f23e-47aa-bb6c-04c1a6605256 could not be found. Jul 19 15:57:47.088683 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: action_args: {'id': '40d79e6b-f23e-47aa-bb6c-04c1a6605256'} Jul 19 15:57:47.089773 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: {{(pid=129520) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 19 15:57:47.089773 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:57:47.089773 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 19 15:57:47.089773 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 19 15:57:47.089773 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 19 15:57:47.089773 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 19 15:57:47.089773 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 19 15:57:47.089773 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 19 15:57:47.089773 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 19 15:57:47.089773 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 19 15:57:47.089773 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40d79e6b-f23e-47aa-bb6c-04c1a6605256 could not be found. Jul 19 15:57:47.089773 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:57:47.089773 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:57:47.089773 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:57:47.089773 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:57:47.089773 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:57:47.089773 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:57:47.089773 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 19 15:57:47.089773 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 19 15:57:47.089773 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 19 15:57:47.091535 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 19 15:57:47.091535 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 19 15:57:47.091535 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 19 15:57:47.091535 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 19 15:57:47.091535 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 19 15:57:47.091535 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 19 15:57:47.091535 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 19 15:57:47.091535 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40d79e6b-f23e-47aa-bb6c-04c1a6605256 could not be found. Jul 19 15:57:47.091535 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:57:47.091535 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 19 15:57:47.091535 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:57:47.091535 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 19 15:57:47.091535 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 19 15:57:47.091535 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 19 15:57:47.091535 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 19 15:57:47.091535 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 19 15:57:47.091535 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40d79e6b-f23e-47aa-bb6c-04c1a6605256 could not be found. Jul 19 15:57:47.091535 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: ERROR nova.api.openstack.wsgi Jul 19 15:57:47.093059 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: DEBUG nova.api.openstack.wsgi [None req-e3b00d0d-7a67-4b4c-9fd0-b213cb870802 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Returning 404 to user: Instance 40d79e6b-f23e-47aa-bb6c-04c1a6605256 could not be found. {{(pid=129520) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 19 15:57:47.093059 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO nova.api.openstack.requestlog [None req-e3b00d0d-7a67-4b4c-9fd0-b213cb870802 tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] 10.222.0.64 "GET /compute/v2.1/servers/40d79e6b-f23e-47aa-bb6c-04c1a6605256" status: 404 len: 111 microversion: 2.1 time: 0.031479 Jul 19 15:57:47.093059 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: [pid: 129520|app: 0|req: 613/1173] 10.222.0.64 () {58 vars in 1235 bytes} [Tue Jul 19 15:57:47 2022] GET /compute/v2.1/servers/40d79e6b-f23e-47aa-bb6c-04c1a6605256 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 19 15:57:47.251448 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: DEBUG nova.api.openstack.wsgi [None req-988742da-a11e-41e7-b317-4608ae6b7abf tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] Calling method '.version_select at 0x7fb8a5b19790>' {{(pid=129519) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 19 15:57:47.272826 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO nova.api.openstack.requestlog [None req-988742da-a11e-41e7-b317-4608ae6b7abf tempest-TestShelveInstance-513174704 tempest-TestShelveInstance-513174704-project] 10.222.0.64 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-11940315" status: 202 len: 0 microversion: 2.1 time: 0.029561 Jul 19 15:57:47.273408 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: [pid: 129519|app: 0|req: 561/1174] 10.222.0.64 () {58 vars in 1247 bytes} [Tue Jul 19 15:57:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-11940315 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 19 15:58:40.641228 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 15:58:40.641852 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Tue Jul 19 15:58:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 15:58:43.621598 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 15:58:43.622228 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Tue Jul 19 15:58:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 16:00:45.748905 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 16:00:45.749545 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Tue Jul 19 16:00:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 16:00:47.847234 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 16:00:47.847771 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Tue Jul 19 16:00:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 16:01:38.950806 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 16:01:38.951559 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Tue Jul 19 16:01:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 16:02:00.650641 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 16:02:00.651457 dv-cinder-849022-3-iscsi devstack@n-api.service[129520]: Tue Jul 19 16:02:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 19 16:02:03.629980 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 19 16:02:03.630624 dv-cinder-849022-3-iscsi devstack@n-api.service[129519]: Tue Jul 19 16:02:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!